Apr 11 18:03:35 user devstack@n-api.service[72341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 18:03:35 user devstack@n-api.service[72341]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 18:03:35 2023] *** Apr 11 18:03:35 user devstack@n-api.service[72341]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 18:03:35 user devstack@n-api.service[72341]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 18:03:35 user devstack@n-api.service[72341]: nodename: user Apr 11 18:03:35 user devstack@n-api.service[72341]: machine: x86_64 Apr 11 18:03:35 user devstack@n-api.service[72341]: clock source: unix Apr 11 18:03:35 user devstack@n-api.service[72341]: pcre jit disabled Apr 11 18:03:35 user devstack@n-api.service[72341]: detected number of CPU cores: 12 Apr 11 18:03:35 user devstack@n-api.service[72341]: current working directory: / Apr 11 18:03:35 user devstack@n-api.service[72341]: detected binary path: /usr/bin/uwsgi-core Apr 11 18:03:35 user devstack@n-api.service[72341]: your processes number limit is 63637 Apr 11 18:03:35 user devstack@n-api.service[72341]: your memory page size is 4096 bytes Apr 11 18:03:35 user devstack@n-api.service[72341]: detected max file descriptor number: 2048 Apr 11 18:03:35 user devstack@n-api.service[72341]: lock engine: pthread robust mutexes Apr 11 18:03:35 user devstack@n-api.service[72341]: thunder lock: enabled Apr 11 18:03:35 user devstack@n-api.service[72341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 18:03:35 user devstack@n-api.service[72341]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 18:03:35 user devstack@n-api.service[72341]: Python main interpreter initialized at 0x5652aaebe990 Apr 11 18:03:35 user devstack@n-api.service[72341]: python threads support enabled Apr 11 18:03:35 user devstack@n-api.service[72341]: your server socket listen backlog is limited to 100 connections Apr 11 18:03:35 user devstack@n-api.service[72341]: your mercy for graceful operations on workers is 90 seconds Apr 11 18:03:35 user devstack@n-api.service[72341]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 18:03:35 user devstack@n-api.service[72341]: *** Operational MODE: preforking *** Apr 11 18:03:35 user devstack@n-api.service[72341]: *** uWSGI is running in multiple interpreter mode *** Apr 11 18:03:35 user devstack@n-api.service[72341]: spawned uWSGI master process (pid: 72341) Apr 11 18:03:35 user devstack@n-api.service[72341]: spawned uWSGI worker 1 (pid: 72343, cores: 1) Apr 11 18:03:35 user devstack@n-api.service[72341]: spawned uWSGI worker 2 (pid: 72344, cores: 1) Apr 11 18:03:35 user devstack@n-api.service[72341]: spawned uWSGI worker 3 (pid: 72345, cores: 1) Apr 11 18:03:35 user devstack@n-api.service[72341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 18:03:36 user devstack@n-api.service[72343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 18:03:36 user devstack@n-api.service[72345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 18:03:36 user devstack@n-api.service[72344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 18:03:39 user devstack@n-api.service[72345]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 18:03:39 user devstack@n-api.service[72345]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 18:03:39 user devstack@n-api.service[72345]: and ``live_migration_inbound_addr`` respectively. Apr 11 18:03:39 user devstack@n-api.service[72345]: ). Its value may be silently ignored in the future. Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 18:03:39 user devstack@n-api.service[72344]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 18:03:39 user devstack@n-api.service[72344]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 18:03:39 user devstack@n-api.service[72344]: and ``live_migration_inbound_addr`` respectively. Apr 11 18:03:39 user devstack@n-api.service[72344]: ). Its value may be silently ignored in the future. Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 18:03:39 user devstack@n-api.service[72343]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 18:03:39 user devstack@n-api.service[72343]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 18:03:39 user devstack@n-api.service[72343]: and ``live_migration_inbound_addr`` respectively. Apr 11 18:03:39 user devstack@n-api.service[72343]: ). Its value may be silently ignored in the future. Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72345) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72344) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72345]: INFO dbcounter [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Registered counter for database nova_api Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72343) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 18:03:39 user devstack@n-api.service[72344]: INFO dbcounter [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Registered counter for database nova_api Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_db.sqlalchemy.engines [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72344) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_db.sqlalchemy.engines [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writer thread running {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writer thread running {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG nova.context [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3(cell1) {{(pid=72344) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:39 user devstack@n-api.service[72343]: INFO dbcounter [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Registered counter for database nova_api Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:39 user devstack@n-api.service[72344]: INFO dbcounter [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Registered counter for database nova_cell0 Apr 11 18:03:39 user devstack@n-api.service[72344]: INFO dbcounter [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Registered counter for database nova_cell1 Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_db.sqlalchemy.engines [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72344) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG nova.context [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3(cell1) {{(pid=72345) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG oslo_db.sqlalchemy.engines [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72344) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writer thread running {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG oslo_db.sqlalchemy.engines [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72343) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:39 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writer thread running {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:39 user devstack@n-api.service[72345]: INFO dbcounter [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Registered counter for database nova_cell0 Apr 11 18:03:39 user devstack@n-api.service[72345]: INFO dbcounter [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Registered counter for database nova_cell1 Apr 11 18:03:39 user devstack@n-api.service[72345]: DEBUG oslo_db.sqlalchemy.engines [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72345]: DEBUG oslo_db.sqlalchemy.engines [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writer thread running {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG nova.context [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3(cell1) {{(pid=72343) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:03:40 user devstack@n-api.service[72343]: INFO dbcounter [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Registered counter for database nova_cell0 Apr 11 18:03:40 user devstack@n-api.service[72343]: INFO dbcounter [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Registered counter for database nova_cell1 Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_db.sqlalchemy.engines [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72343) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writer thread running {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_db.sqlalchemy.engines [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72343) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writer thread running {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72344]: INFO dbcounter [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Registered counter for database nova_cell0 Apr 11 18:03:40 user devstack@n-api.service[72344]: DEBUG oslo_db.sqlalchemy.engines [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72344) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writer thread running {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writer thread running {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72345]: INFO dbcounter [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Registered counter for database nova_cell0 Apr 11 18:03:40 user devstack@n-api.service[72345]: DEBUG oslo_db.sqlalchemy.engines [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72345) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writer thread running {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writer thread running {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72343]: INFO dbcounter [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Registered counter for database nova_cell0 Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG oslo_db.sqlalchemy.engines [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72343) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 18:03:40 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writer thread running {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 18:03:40 user devstack@n-api.service[72344]: WARNING keystonemiddleware.auth_token [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72344]: WARNING keystonemiddleware.auth_token [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72345]: WARNING keystonemiddleware.auth_token [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72345]: WARNING keystonemiddleware.auth_token [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72343]: WARNING keystonemiddleware.auth_token [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72343]: WARNING keystonemiddleware.auth_token [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72344]: WARNING keystonemiddleware.auth_token [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72344]: WARNING keystonemiddleware.auth_token [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72344]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652aaebe990 pid: 72344 (default app) Apr 11 18:03:40 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:03:40 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001438 Apr 11 18:03:40 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 18:03:40 2023] GET /compute/v2.1/ => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:03:40 user devstack@n-api.service[72345]: WARNING keystonemiddleware.auth_token [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72345]: WARNING keystonemiddleware.auth_token [None req-a804dd99-1561-4bbd-a6dd-eadb1a7b0e72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72345]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652aaebe990 pid: 72345 (default app) Apr 11 18:03:40 user devstack@n-api.service[72343]: WARNING keystonemiddleware.auth_token [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 18:03:40 user devstack@n-api.service[72343]: WARNING keystonemiddleware.auth_token [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 18:03:40 user devstack@n-api.service[72343]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652aaebe990 pid: 72343 (default app) Apr 11 18:05:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9a975c3d-bec9-4c8c-9a3a-f83beced6113 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001465 Apr 11 18:05:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-4f1ba06e-c48f-4f5a-a7cc-15015e412f8b admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-4f1ba06e-c48f-4f5a-a7cc-15015e412f8b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.396070 Apr 11 18:05:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 18:05:48 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:05:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002688 Apr 11 18:05:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:51 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:05:51 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9f1cdf39-65c4-42e6-bc1b-a04fac29385a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "vcpus": 1, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:51 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9f1cdf39-65c4-42e6-bc1b-a04fac29385a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.331977 Apr 11 18:05:51 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:05:51 2023] POST /compute/v2.1/flavors => generated 405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:05:51 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f71cd81a-b818-48f7-8129-1b28b4e625b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:51 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f71cd81a-b818-48f7-8129-1b28b4e625b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086736 Apr 11 18:05:51 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 18:05:51 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:05:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001334 Apr 11 18:05:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-69e86bb7-09e2-426f-bcef-a1af6d451de1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "name": "ds512M"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:53 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-69e86bb7-09e2-426f-bcef-a1af6d451de1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.056209 Apr 11 18:05:53 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:05:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:05:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1ab09062-ca9b-40a4-8582-d358b1e6a533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1ab09062-ca9b-40a4-8582-d358b1e6a533 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026191 Apr 11 18:05:53 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 18:05:53 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:05:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001384 Apr 11 18:05:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:55 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3a4b3666-df4c-44b5-9ae3-ebb6a40ef83b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3a4b3666-df4c-44b5-9ae3-ebb6a40ef83b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070998 Apr 11 18:05:55 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:05:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:05:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-984516fc-e1af-44d3-954f-8c7365bf124c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-984516fc-e1af-44d3-954f-8c7365bf124c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027540 Apr 11 18:05:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 18:05:55 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:05:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 11 18:05:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9ea244c8-9ba9-4117-b7e7-b4c3e3a94490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9ea244c8-9ba9-4117-b7e7-b4c3e3a94490 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057466 Apr 11 18:05:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:05:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:05:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-06443e66-1571-4f67-b10f-c87aea0bd306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-06443e66-1571-4f67-b10f-c87aea0bd306 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026271 Apr 11 18:05:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 18:05:57 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:05:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:05:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001336 Apr 11 18:05:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:05:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:05:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-43c25169-4daa-49a2-a492-ddd12c1a9b77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-43c25169-4daa-49a2-a492-ddd12c1a9b77 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059372 Apr 11 18:05:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:05:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:05:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:05:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023833 Apr 11 18:05:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 18:05:59 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:01 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dd65f25f-e1e2-4d5e-af6c-d4ff516bd594 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001769 Apr 11 18:06:01 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:01 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ef54a43a-96d3-4780-b9ba-cf924a635a42 admin admin] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:02 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ef54a43a-96d3-4780-b9ba-cf924a635a42 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070163 Apr 11 18:06:02 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 18:06:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:06:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001467 Apr 11 18:06:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:06:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:06:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:06:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:06:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7cd5d895-57ba-46b6-b5c1-1ad8c2577370 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7cd5d895-57ba-46b6-b5c1-1ad8c2577370 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.327488 Apr 11 18:06:04 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:06:03 2023] POST /compute/v2.1/flavors => generated 400 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:06:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9a1ae9ca-3d25-4c21-aad0-702b84f86660 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9a1ae9ca-3d25-4c21-aad0-702b84f86660 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044718 Apr 11 18:06:04 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 18:06:04 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001300 Apr 11 18:06:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6225199d-c8a2-407d-8641-83b9252ee109 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6225199d-c8a2-407d-8641-83b9252ee109 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060023 Apr 11 18:06:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:06:06 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:06:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-51b426dc-b5b1-4aa1-aa57-f28c216a3116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-51b426dc-b5b1-4aa1-aa57-f28c216a3116 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028795 Apr 11 18:06:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 18:06:06 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001414 Apr 11 18:06:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-731cbd0e-f3e4-4ca3-80ee-e56773aa7497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-731cbd0e-f3e4-4ca3-80ee-e56773aa7497 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063174 Apr 11 18:06:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:06:08 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:06:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9a519ab3-a4e4-4af1-be6b-329c91824ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9a519ab3-a4e4-4af1-be6b-329c91824ba3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027628 Apr 11 18:06:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 18:06:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001370 Apr 11 18:06:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ad5ff350-9000-41c2-857c-b908d48a91ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ad5ff350-9000-41c2-857c-b908d48a91ed admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.122300 Apr 11 18:06:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:06:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:06:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e36cb96d-721b-4b86-8bf3-2655493a4c19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e36cb96d-721b-4b86-8bf3-2655493a4c19 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026202 Apr 11 18:06:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 18:06:10 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001878 Apr 11 18:06:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 18:06:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:06:12 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9ccf629b-0ac9-4df8-9fdd-325d0596753c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9ccf629b-0ac9-4df8-9fdd-325d0596753c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067296 Apr 11 18:06:12 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 18:06:12 2023] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:06:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b0101148-1e87-44da-9f08-345be5d34b6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:06:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b0101148-1e87-44da-9f08-345be5d34b6e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024311 Apr 11 18:06:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 18:06:12 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:06:44 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7e6265f1-d640-40f3-8935-c98aec166162 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001534 Apr 11 18:06:44 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 18:06:44 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:06:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:06:44 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.093972 Apr 11 18:06:44 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 18:06:44 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:07:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b0101148-1e87-44da-9f08-345be5d34b6e admin admin] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:07:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b0101148-1e87-44da-9f08-345be5d34b6e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002114 Apr 11 18:07:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 18:07:16 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:07:16 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:07:16 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c190a360-01ec-4698-935f-41807a222102 admin admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:07:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c190a360-01ec-4698-935f-41807a222102 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.067142 Apr 11 18:07:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 18:07:16 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:07:21 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:07:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002653 Apr 11 18:07:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 18:07:21 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:07:21 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:07:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-012f867f-7977-4e99-b5f1-a1625cbce210 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "42", "rxtx_factor": 1.0, "ram": 128, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.nano"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:07:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-012f867f-7977-4e99-b5f1-a1625cbce210 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071255 Apr 11 18:07:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 18:07:21 2023] POST /compute/v2.1/flavors => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:07:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7a1e1007-2d54-4530-b1ea-19efacf1ba1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:07:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7a1e1007-2d54-4530-b1ea-19efacf1ba1d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025252 Apr 11 18:07:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 18:07:21 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:07:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:07:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-409fd17c-3fbc-4300-9c75-7e460662cc4a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002373 Apr 11 18:07:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 18:07:25 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:07:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1c5bde2e-ed43-46dd-8702-3ab8ea0101db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 192, "id": "84", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:07:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-1c5bde2e-ed43-46dd-8702-3ab8ea0101db admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059989 Apr 11 18:07:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 18:07:25 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:07:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-93d33c84-7520-4d6a-967d-b886b471d7d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:07:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-93d33c84-7520-4d6a-967d-b886b471d7d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023084 Apr 11 18:07:25 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 18:07:25 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:09:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:09:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:09:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:09:59 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:09:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-666810633", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:09:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3a6cbe1-7a84-47b3-9f1c-eb1914bf1f3c tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'create', calling method: .version_select at 0x7fadba69a5f0>, body: {"keypair": {"name": "tempest-keypair-1352570335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfbRQOA+YTKOQ+lZdoJpkrj7VvUUe/6HtKV2apcueDmrB+0261QbqAV8wZxYggyb2JZ0aCJhf8E6yndBbQDy5N2d5vbP3AMf66KfCVAJDPoSHsP3ioPNDUjt3X0FB0lfw=="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:09:59 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-c3a6cbe1-7a84-47b3-9f1c-eb1914bf1f3c tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting quotas for project 964624241aac4d7ba6b2b9ffca6e7d8a. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:09:59 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-c3a6cbe1-7a84-47b3-9f1c-eb1914bf1f3c tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting quotas for user 1e62201c2b4e4763bae71280d81ff5e4 and project 964624241aac4d7ba6b2b9ffca6e7d8a. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:09:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c3a6cbe1-7a84-47b3-9f1c-eb1914bf1f3c tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210331 Apr 11 18:09:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 17/46] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:09:59 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:09:59 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:09:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1892408024", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:09:59 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] validate_networks() for [('60e8714f-81c9-47a6-adab-bf1ca8ef28b1', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:00 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] validate_networks() for [('0c782c31-14df-4b47-a7bc-3191698e4825', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for user 908e0b5a1ce14f5cb636eda79ac77f7b and project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.778733 Apr 11 18:10:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:09:59 2023] POST /compute/v2.1/servers => generated 381 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-00388ffe-b3b5-4775-b966-67f3ff685b45 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:01 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-00388ffe-b3b5-4775-b966-67f3ff685b45 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Getting quotas for project ba695867a2a94155820b99174b93499b. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Getting quotas for user 20dbffe38f4e4be08599eb1f2fa2bc38 and project ba695867a2a94155820b99174b93499b. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:01 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:01 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-00388ffe-b3b5-4775-b966-67f3ff685b45 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-00388ffe-b3b5-4775-b966-67f3ff685b45 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1216 microversion: 2.1 time: 0.367500 Apr 11 18:10:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 18/48] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:01 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1216 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.552757 Apr 11 18:10:01 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 15/49] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:09:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-da940cbf-3298-4e2d-a6f1-be87a8b7439a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-da940cbf-3298-4e2d-a6f1-be87a8b7439a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:02 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1852666843", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:02 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-da940cbf-3298-4e2d-a6f1-be87a8b7439a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20dbffe38f4e4be08599eb1f2fa2bc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba695867a2a94155820b99174b93499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:02 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] validate_networks() for [('0c782c31-14df-4b47-a7bc-3191698e4825', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-da940cbf-3298-4e2d-a6f1-be87a8b7439a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638" status: 200 len: 1207 microversion: 2.1 time: 0.165620 Apr 11 18:10:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:01 2023] GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 => generated 1207 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for user 908e0b5a1ce14f5cb636eda79ac77f7b and project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.288253 Apr 11 18:10:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 19/51] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:02 2023] POST /compute/v2.1/servers => generated 381 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a30f0a17-3357-4775-87c7-54c6cd7a0c72 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a30f0a17-3357-4775-87c7-54c6cd7a0c72 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:03 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a30f0a17-3357-4775-87c7-54c6cd7a0c72 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a30f0a17-3357-4775-87c7-54c6cd7a0c72 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 200 len: 1216 microversion: 2.1 time: 0.243418 Apr 11 18:10:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 16/52] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:03 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8e35d3bc-872f-4650-a949-616bf6f64f08 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: .version_select at 0x7fadba5944c0>, body: {"keypair": {"name": "tempest-keypair-154558437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:04 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-8e35d3bc-872f-4650-a949-616bf6f64f08 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:04 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-8e35d3bc-872f-4650-a949-616bf6f64f08 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8e35d3bc-872f-4650-a949-616bf6f64f08 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.371698 Apr 11 18:10:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 18/53] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:10:04 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684803225", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "4ab57744-6e8a-413d-af38-dc59ba765d33"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:06 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] validate_networks() for [('4ab57744-6e8a-413d-af38-dc59ba765d33', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:07 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1977485148", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "1b2fd4c9-6e15-4279-b820-328bb377d778"}], "security_groups": [{"name": "tempest-securitygroup--1734690595"}], "key_name": "tempest-keypair-1352570335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:07 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] validate_networks() for [('1b2fd4c9-6e15-4279-b820-328bb377d778', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Getting quotas for project 972a578943144e9d8b27c8c1367a7ab0. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Getting quotas for user 5fd5ab7a54de4c7eae01368522ec9b6f and project 972a578943144e9d8b27c8c1367a7ab0. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.038310 Apr 11 18:10:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 20/54] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8d4fe630-d83f-4410-a90d-6cd076544a3b tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8d4fe630-d83f-4410-a90d-6cd076544a3b tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:08 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-8d4fe630-d83f-4410-a90d-6cd076544a3b tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd5ab7a54de4c7eae01368522ec9b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972a578943144e9d8b27c8c1367a7ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8d4fe630-d83f-4410-a90d-6cd076544a3b tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 200 len: 1208 microversion: 2.1 time: 0.143483 Apr 11 18:10:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 19/55] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:08 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 1208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting quotas for project 964624241aac4d7ba6b2b9ffca6e7d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting quotas for user 1e62201c2b4e4763bae71280d81ff5e4 and project 964624241aac4d7ba6b2b9ffca6e7d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.388327 Apr 11 18:10:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 17/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 2390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a0214758-958b-4a0e-8448-8466a892564e tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a0214758-958b-4a0e-8448-8466a892564e tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a0214758-958b-4a0e-8448-8466a892564e tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a0214758-958b-4a0e-8448-8466a892564e tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1240 microversion: 2.1 time: 0.141037 Apr 11 18:10:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 21/57] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:09 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Creating event network-changed:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72345]: INFO nova.compute.rpcapi [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 18:10:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] Releasing lock "compute-rpcapi-router" {{(pid=72345) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 18:10:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e0eb369c-057e-4b31-83c2-dc15536e22a0 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157948 Apr 11 18:10:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 20/58] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Creating event network-changed:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72343) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Acquired lock "compute-rpcapi-router" {{(pid=72343) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:11 user devstack@n-api.service[72343]: INFO nova.compute.rpcapi [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 18:10:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] Releasing lock "compute-rpcapi-router" {{(pid=72343) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 18:10:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ce65c941-9592-4b6b-af8d-416c7e21c808 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148858 Apr 11 18:10:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 18/59] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:13 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Creating event network-changed:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72344) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=72344) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:13 user devstack@n-api.service[72344]: INFO nova.compute.rpcapi [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 18:10:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] Releasing lock "compute-rpcapi-router" {{(pid=72344) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 18:10:13 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-be06644a-7b1e-41e2-b23b-c75ae537d08e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209480 Apr 11 18:10:13 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 22/60] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1599225915", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6960067f-92d2-4975-8467-4b8d4d2f9933"}], "security_groups": [{"name": "tempest-securitygroup--14530514"}], "key_name": "tempest-keypair-154558437", "user_data": "}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:14 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] validate_networks() for [('6960067f-92d2-4975-8467-4b8d4d2f9933', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:15 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:16 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:16 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.615472 Apr 11 18:10:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 21/61] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:13 2023] POST /compute/v2.1/servers => generated 405 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d4c154c2-0d68-4770-a708-b96aa2bd8b43 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d4c154c2-0d68-4770-a708-b96aa2bd8b43 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d4c154c2-0d68-4770-a708-b96aa2bd8b43 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d4c154c2-0d68-4770-a708-b96aa2bd8b43 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1232 microversion: 2.1 time: 0.302891 Apr 11 18:10:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 19/62] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:16 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1232 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Creating event network-changed:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:10:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046981 Apr 11 18:10:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 23/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:10:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046414 Apr 11 18:10:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 20/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-125a425d-4f28-42eb-858c-a236aee7944c tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Action: 'create', calling method: .version_select at 0x7fadba5df1c0>, body: {"keypair": {"name": "tempest-keypair-752484616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0URwNWIYJkMnsH7m5y9Ix5AGr3fUW1mmaNHKkOgHReSsf7+ifIsMRKy3D+5OUYVR+uALgWoGRZVY/SK5EoQHgh4Tqa+XoLfK43xtpIx2sSmLqhVUgk3pmOtflWsIvJBw=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:19 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-125a425d-4f28-42eb-858c-a236aee7944c tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting quotas for project b181392922e741a784b8a0d59ca79f7f. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:19 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-125a425d-4f28-42eb-858c-a236aee7944c tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting quotas for user 9b6375313b85465aa965faf4b75eec5c and project b181392922e741a784b8a0d59ca79f7f. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-125a425d-4f28-42eb-858c-a236aee7944c tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.397557 Apr 11 18:10:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:10:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Creating event network-changed:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:10:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054891 Apr 11 18:10:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 24/66] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:10:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ce200418-4bad-4e07-a196-a3d1dc53f1be tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Action: 'create', calling method: .version_select at 0x7fadba5e3250>, body: {"keypair": {"name": "tempest-keypair-1379978453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItze44OHRrzTJBXg4OENnJbauHoiu2rr3GWBqGL/9xCDLTcFJAl0TKCQF1smiP/y4xObggC6qDCPDzTrqWWOTF3SJ0yaeDG4pl0IVe4P1xS4HSXTcR8yMA4STp3p767Q=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-ce200418-4bad-4e07-a196-a3d1dc53f1be tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting quotas for project 19acb9280d2f48b59ad7b2fde0e4efb3. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-ce200418-4bad-4e07-a196-a3d1dc53f1be tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting quotas for user a6d4a1de4c8e49a0a14eec670db8ff0f and project 19acb9280d2f48b59ad7b2fde0e4efb3. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ce200418-4bad-4e07-a196-a3d1dc53f1be tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107476 Apr 11 18:10:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 21/67] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:10:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}, {"server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "name": "network-vif-plugged", "status": "completed", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}, {"server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "name": "network-vif-plugged", "status": "completed", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:10:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Creating event network-vif-plugged:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:10:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Creating event network-vif-plugged:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:10:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063617 Apr 11 18:10:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:21 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:22 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=20 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:22 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:22 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:10:22 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059740 Apr 11 18:10:22 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 25/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1530757380", "imageRef": "f23e66cf-31f3-42e5-a4a8-81cf2a978f9b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8"}], "security_groups": [{"name": "tempest-securitygroup--828215344"}], "key_name": "tempest-keypair-752484616", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:23 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "name": "network-vif-plugged", "status": "completed", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Creating event network-vif-plugged:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:10:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082112 Apr 11 18:10:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:24 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] validate_networks() for [('21b08926-47cc-4bfc-9e0a-ce97c7914ba8', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:24 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:10:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062610 Apr 11 18:10:24 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 26/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-410575530", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "2307a7f8-7485-4e74-b310-f37dec5e8469"}], "security_groups": [{"name": "tempest-securitygroup--1467045778"}], "key_name": "tempest-keypair-1379978453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:25 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] validate_networks() for [('2307a7f8-7485-4e74-b310-f37dec5e8469', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:25 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "name": "network-vif-plugged", "status": "completed", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Creating event network-vif-plugged:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:10:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053998 Apr 11 18:10:26 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 27/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting quotas for project 19acb9280d2f48b59ad7b2fde0e4efb3. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting quotas for user a6d4a1de4c8e49a0a14eec670db8ff0f and project 19acb9280d2f48b59ad7b2fde0e4efb3. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.899220 Apr 11 18:10:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 25/73] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8d781455-a3fd-424f-be26-d6ba554e85df tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8d781455-a3fd-424f-be26-d6ba554e85df tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8d781455-a3fd-424f-be26-d6ba554e85df tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d4a1de4c8e49a0a14eec670db8ff0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19acb9280d2f48b59ad7b2fde0e4efb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8d781455-a3fd-424f-be26-d6ba554e85df tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585" status: 200 len: 1225 microversion: 2.1 time: 0.129688 Apr 11 18:10:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 28/74] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:27 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting quotas for project b181392922e741a784b8a0d59ca79f7f. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting quotas for user 9b6375313b85465aa965faf4b75eec5c and project b181392922e741a784b8a0d59ca79f7f. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:27 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 4.141280 Apr 11 18:10:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 22/75] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:10:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 4144 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-4f8e9388-5c12-4434-acb3-f163f2d47790 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-4f8e9388-5c12-4434-acb3-f163f2d47790 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:27 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-4f8e9388-5c12-4434-acb3-f163f2d47790 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6375313b85465aa965faf4b75eec5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181392922e741a784b8a0d59ca79f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-4f8e9388-5c12-4434-acb3-f163f2d47790 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 200 len: 1239 microversion: 2.1 time: 0.202960 Apr 11 18:10:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:27 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:10:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206895 Apr 11 18:10:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 29/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}, {"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=10 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=13 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Creating event network-changed:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:10:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:10:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106301 Apr 11 18:10:30 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 23/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=11 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:31 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=15 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:10:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247047 Apr 11 18:10:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:33 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2c4f6a20-4425-467c-a799-3a0bfd05bf83 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Action: 'create', calling method: .version_select at 0x7fadba411c60>, body: {"keypair": {"name": "tempest-keypair-120431301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg=="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:33 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-2c4f6a20-4425-467c-a799-3a0bfd05bf83 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting quotas for project 9376efafce66467aa4efde41acbce713. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:33 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-2c4f6a20-4425-467c-a799-3a0bfd05bf83 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting quotas for user d70760a1251b4629afcc8c80ae00c659 and project 9376efafce66467aa4efde41acbce713. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2c4f6a20-4425-467c-a799-3a0bfd05bf83 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.178206 Apr 11 18:10:33 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 30/80] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 18:10:33 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:10:33 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:34 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:10:34 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046661 Apr 11 18:10:34 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 24/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Creating event network-changed:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:10:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120296 Apr 11 18:10:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:10:34 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:34 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=21 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Creating event network-changed:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:10:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047505 Apr 11 18:10:34 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 31/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1489917956", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3821437a-f673-4707-9824-285d5363f1c3"}], "security_groups": [{"name": "tempest-securitygroup--1189445762"}], "key_name": "tempest-keypair-120431301", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:37 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] validate_networks() for [('3821437a-f673-4707-9824-285d5363f1c3', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=26 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "name": "network-vif-plugged", "status": "completed", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Creating event network-vif-plugged:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:10:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100884 Apr 11 18:10:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting quotas for project 9376efafce66467aa4efde41acbce713. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting quotas for user d70760a1251b4629afcc8c80ae00c659 and project 9376efafce66467aa4efde41acbce713. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.477151 Apr 11 18:10:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 25/85] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:10:36 2023] POST /compute/v2.1/servers => generated 404 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:10:38 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:38 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f726dae1-d7ae-4b37-b935-b146c37d487b tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 200 len: 1320 microversion: 2.49 time: 0.116306 Apr 11 18:10:38 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 32/86] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:10:38 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:10:39 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=32 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "name": "network-vif-plugged", "status": "completed", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Creating event network-vif-plugged:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:10:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079364 Apr 11 18:10:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:10:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "name": "network-vif-plugged", "status": "completed", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Creating event network-vif-plugged:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:10:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083496 Apr 11 18:10:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 26/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "name": "network-vif-plugged", "status": "completed", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Creating event network-vif-plugged:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:10:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032299 Apr 11 18:10:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 33/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:10:43 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Creating event network-changed:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:10:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062317 Apr 11 18:10:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Creating event network-vif-plugged:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:10:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048536 Apr 11 18:10:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 27/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:48 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Creating event network-vif-plugged:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:10:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045906 Apr 11 18:10:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 34/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:10:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-19fc0688-89e5-40ef-8ef1-a20968e04394 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Action: 'create', calling method: .version_select at 0x7fadba5dfd00>, body: {"keypair": {"name": "tempest-keypair-2140518670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:49 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-19fc0688-89e5-40ef-8ef1-a20968e04394 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting quotas for project e235e9f2e72e4fc28995bf9716d8e4ff. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:49 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-19fc0688-89e5-40ef-8ef1-a20968e04394 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting quotas for user 7c63dc594a1a4977b67ccc1a63d09de4 and project e235e9f2e72e4fc28995bf9716d8e4ff. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-19fc0688-89e5-40ef-8ef1-a20968e04394 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.055202 Apr 11 18:10:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 32/93] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 18:10:49 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:10:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-29f0a650-db4c-495f-adb1-86cb6aadc6e8 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Action: 'create', calling method: .version_select at 0x7fadba5e3d00>, body: {"keypair": {"name": "tempest-keypair-1551663442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:50 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:50 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:50 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-29f0a650-db4c-495f-adb1-86cb6aadc6e8 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting quotas for project 661f042c46b14d2184cfaa77200899a8. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:50 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-29f0a650-db4c-495f-adb1-86cb6aadc6e8 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting quotas for user 59738138e8c346a393ea13fe7fadbe88 and project 661f042c46b14d2184cfaa77200899a8. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-29f0a650-db4c-495f-adb1-86cb6aadc6e8 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.064863 Apr 11 18:10:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 28/94] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 18:10:50 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:10:51 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-570145889", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b27cadcc-09a1-423c-9133-cc109a427485"}, {"port": "218012bb-cbbd-412d-85af-8c76ac2c273d", "tag": "port-1"}, {"port": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "tag": "port-2"}, {"uuid": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "tag": "net-1"}, {"uuid": "3be15b3c-4641-4591-9b74-24b58a38b9dc"}, {"uuid": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ffe808d1-d7d3-4c81-b366-1b777fac9dee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2f7af65f-1aed-4e9e-b945-688f1ab39728", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "858c22bc-7928-4813-9303-f52929365664", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1937345046"}], "key_name": "tempest-keypair-2140518670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:51 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] validate_networks() for [('b27cadcc-09a1-423c-9133-cc109a427485', None, None, None, None, None), (None, None, '218012bb-cbbd-412d-85af-8c76ac2c273d', None, None, None), (None, None, '9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c', None, None, None), ('3be15b3c-4641-4591-9b74-24b58a38b9dc', None, None, None, None, None), ('3be15b3c-4641-4591-9b74-24b58a38b9dc', None, None, None, None, None), ('eec313a6-f214-4b6e-bac2-d847c99dcedc', '10.2.2.100', None, None, None, None), ('eec313a6-f214-4b6e-bac2-d847c99dcedc', '10.2.2.200', None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:51 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-490010717", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81"}, {"port": "903ba719-5693-44ed-985d-74770767b6c5", "tag": "port-1"}, {"port": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "tag": "port-2"}, {"uuid": "3835c27b-305e-44a8-96aa-82303b37dd32", "tag": "net-1"}, {"uuid": "3835c27b-305e-44a8-96aa-82303b37dd32"}, {"uuid": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f02bca93-4b17-45a3-bf13-273b5d34dc02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a4caf909-3c23-44c2-a1c4-72152f20bb4e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "da10aa27-09c0-4428-b528-8c5555a12970", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--485920975"}], "key_name": "tempest-keypair-1551663442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:10:51 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] validate_networks() for [('dd87d5bb-3e1f-4693-a28a-fee040d4ab81', None, None, None, None, None), (None, None, '903ba719-5693-44ed-985d-74770767b6c5', None, None, None), (None, None, 'cec9b7a9-6277-4820-8c0b-0fb252127d98', None, None, None), ('3835c27b-305e-44a8-96aa-82303b37dd32', None, None, None, None, None), ('3835c27b-305e-44a8-96aa-82303b37dd32', None, None, None, None, None), ('9c992bb3-551b-4636-b2b8-4d2d82add7e3', '10.2.2.100', None, None, None, None), ('9c992bb3-551b-4636-b2b8-4d2d82add7e3', '10.2.2.200', None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:52 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20dbffe38f4e4be08599eb1f2fa2bc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba695867a2a94155820b99174b93499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3885e106-4f64-4a6c-9b47-0c98a8cb5dab tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638" status: 200 len: 1482 microversion: 2.1 time: 0.282648 Apr 11 18:10:52 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 29/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:52 2023] GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 => generated 1482 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:10:53 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=9 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:53 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-25fd8019-bb4c-475a-a3ce-f6a6041ae2b1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 200 len: 1504 microversion: 2.1 time: 0.238286 Apr 11 18:10:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 30/96] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:53 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting quotas for project e235e9f2e72e4fc28995bf9716d8e4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting quotas for user 7c63dc594a1a4977b67ccc1a63d09de4 and project e235e9f2e72e4fc28995bf9716d8e4ff. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ffe808d1-d7d3-4c81-b366-1b777fac9dee',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2f7af65f-1aed-4e9e-b945-688f1ab39728',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='858c22bc-7928-4813-9303-f52929365664',volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting quotas for project 661f042c46b14d2184cfaa77200899a8. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting quotas for user 59738138e8c346a393ea13fe7fadbe88 and project 661f042c46b14d2184cfaa77200899a8. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:10:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f02bca93-4b17-45a3-bf13-273b5d34dc02',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a4caf909-3c23-44c2-a1c4-72152f20bb4e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da10aa27-09c0-4428-b528-8c5555a12970',volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:10:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 4.869433 Apr 11 18:10:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 35/97] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 18:10:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 4872 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:10:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:56 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:56 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9df70e7a-fbf4-4223-86b3-5ad7e51bffcf tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 200 len: 1279 microversion: 2.42 time: 0.109708 Apr 11 18:10:56 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 31/98] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:10:56 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:10:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 4.885765 Apr 11 18:10:56 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 33/99] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 18:10:51 2023] POST /compute/v2.1/servers => generated 403 bytes in 4887 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:10:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-db6b1f32-01bd-48b1-9159-6564aa4d3eca tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 200 len: 1279 microversion: 2.32 time: 0.088027 Apr 11 18:10:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 36/100] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:10:56 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:10:58 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd5ab7a54de4c7eae01368522ec9b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972a578943144e9d8b27c8c1367a7ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:10:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2b6b14b4-d787-41fa-bef9-cf645222112d tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 200 len: 1490 microversion: 2.1 time: 0.224605 Apr 11 18:10:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 32/101] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:10:58 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 1490 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:00 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9f9bf23a-ae33-48c8-a473-8b10812f83ae tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1553 microversion: 2.1 time: 0.361425 Apr 11 18:11:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:00 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Creating event network-changed:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068953 Apr 11 18:11:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 37/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:04 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=28 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Creating event network-changed:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036470 Apr 11 18:11:04 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 33/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:05 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "218012bb-cbbd-412d-85af-8c76ac2c273d"}, {"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:05 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Creating event network-changed:218012bb-cbbd-412d-85af-8c76ac2c273d for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Creating event network-changed:9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035370 Apr 11 18:11:05 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:05 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "903ba719-5693-44ed-985d-74770767b6c5"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:06 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=10 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Creating event network-changed:903ba719-5693-44ed-985d-74770767b6c5 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034853 Apr 11 18:11:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 38/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:06 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e601eabe-8beb-42d8-bd00-f16f6a462a00 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1537 microversion: 2.1 time: 0.235345 Apr 11 18:11:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 34/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:06 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=10 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}, {"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Creating event network-changed:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Creating event network-changed:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035636 Apr 11 18:11:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "cec9b7a9-6277-4820-8c0b-0fb252127d98"}, {"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Creating event network-changed:cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Creating event network-changed:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041445 Apr 11 18:11:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 39/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Creating event network-changed:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028745 Apr 11 18:11:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 35/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Creating event network-changed:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032527 Apr 11 18:11:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Creating event network-changed:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035688 Apr 11 18:11:11 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 40/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:12 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}, {"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Creating event network-changed:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Creating event network-changed:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031492 Apr 11 18:11:12 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:17 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d4a1de4c8e49a0a14eec670db8ff0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19acb9280d2f48b59ad7b2fde0e4efb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b81d9121-fade-4165-8338-caf2607288aa tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585" status: 200 len: 1525 microversion: 2.1 time: 0.156517 Apr 11 18:11:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:17 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:18 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6375313b85465aa965faf4b75eec5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181392922e741a784b8a0d59ca79f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e5cef482-6c54-4d92-82c7-4131dac8d46b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 200 len: 1548 microversion: 2.1 time: 0.426719 Apr 11 18:11:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 41/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:17 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 1548 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-98bfb6ad-8931-4c45-b991-fbae8d793ad2 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: .version_select at 0x7fadb9c3b760>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1430519022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-98bfb6ad-8931-4c45-b991-fbae8d793ad2 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for project a70e133c013140e1a17804737f4e3ef7. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:11:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-98bfb6ad-8931-4c45-b991-fbae8d793ad2 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for user dd1c4ded6c544d6eb16e9086c6259750 and project a70e133c013140e1a17804737f4e3ef7. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:11:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-98bfb6ad-8931-4c45-b991-fbae8d793ad2 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056225 Apr 11 18:11:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 37/116] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:11:20 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-621502840", "imageRef": "88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1430519022", "networks": [{"uuid": "bd1220d9-28b4-4637-b373-8e8e6cc4131f"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:20 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] validate_networks() for [('bd1220d9-28b4-4637-b373-8e8e6cc4131f', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for project a70e133c013140e1a17804737f4e3ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for user dd1c4ded6c544d6eb16e9086c6259750 and project a70e133c013140e1a17804737f4e3ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:11:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:11:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.566484 Apr 11 18:11:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 39/117] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:11:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:11:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-583d03c6-e4f9-4bb9-b841-84117a3d0896 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:21 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-583d03c6-e4f9-4bb9-b841-84117a3d0896 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:21 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-583d03c6-e4f9-4bb9-b841-84117a3d0896 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-583d03c6-e4f9-4bb9-b841-84117a3d0896 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1252 microversion: 2.1 time: 0.097358 Apr 11 18:11:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 42/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:21 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:24 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=11 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Creating event network-vif-plugged:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036688 Apr 11 18:11:24 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:11:24 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "903ba719-5693-44ed-985d-74770767b6c5"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:24 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=23 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:24 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Creating event network-vif-plugged:903ba719-5693-44ed-985d-74770767b6c5 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:24 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042592 Apr 11 18:11:24 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Creating event network-vif-plugged:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Creating event network-vif-plugged:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Creating event network-vif-plugged:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037077 Apr 11 18:11:26 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 43/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:26 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "903ba719-5693-44ed-985d-74770767b6c5"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "cec9b7a9-6277-4820-8c0b-0fb252127d98"}, {"name": "network-changed", "server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "cec9b7a9-6277-4820-8c0b-0fb252127d98"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Creating event network-vif-plugged:903ba719-5693-44ed-985d-74770767b6c5 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Creating event network-vif-plugged:cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Creating event network-changed:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Creating event network-vif-plugged:cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Creating event network-vif-plugged:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 863 microversion: 2.1 time: 0.057494 Apr 11 18:11:26 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 39/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 863 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:28 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:28 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Creating event network-vif-plugged:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:28 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Creating event network-vif-plugged:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:28 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045987 Apr 11 18:11:28 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:28 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "218012bb-cbbd-412d-85af-8c76ac2c273d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:28 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f240e624-bce0-4599-81f4-629e097fd54c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 200 len: 1628 microversion: 2.49 time: 0.243857 Apr 11 18:11:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 44/124] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:11:28 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 1628 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 18:11:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Creating event network-vif-plugged:218012bb-cbbd-412d-85af-8c76ac2c273d for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.040858 Apr 11 18:11:28 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 40/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "218012bb-cbbd-412d-85af-8c76ac2c273d"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c"}, {"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}, {"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:218012bb-cbbd-412d-85af-8c76ac2c273d for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Creating event network-vif-plugged:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1551 microversion: 2.1 time: 0.057851 Apr 11 18:11:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 18:11:30 2023] POST /compute/v2.1/os-server-external-events => generated 1551 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Creating event network-vif-plugged:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046051 Apr 11 18:11:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 45/127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:32 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:32 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Creating event network-vif-plugged:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Creating event network-vif-plugged:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044303 Apr 11 18:11:32 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 41/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:33 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Creating event network-vif-plugged:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:11:33 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035220 Apr 11 18:11:33 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=17 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=21 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:46 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-535dae13-fcb6-4418-b377-6f648e4f3f87 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 200 len: 2829 microversion: 2.42 time: 0.222811 Apr 11 18:11:46 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 46/130] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:11:46 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 2829 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-05c79c54-4c20-40a2-a9c5-cc3f04be6c14 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 200 len: 2818 microversion: 2.32 time: 0.244767 Apr 11 18:11:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 42/131] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:11:46 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 2818 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=7 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:54 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:11:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674/action" status: 200 len: 32 microversion: 2.1 time: 0.400406 Apr 11 18:11:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:11:53 2023] POST /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:54 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-cf5d61eb-d885-442e-a7b2-22fc434e5d3b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 200 len: 1510 microversion: 2.1 time: 0.181487 Apr 11 18:11:54 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 47/133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:54 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-unplugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Creating event network-vif-unplugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:11:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034049 Apr 11 18:11:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:11:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638" status: 204 len: 0 microversion: 2.1 time: 0.158817 Apr 11 18:11:56 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:11:56 2023] DELETE /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20dbffe38f4e4be08599eb1f2fa2bc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba695867a2a94155820b99174b93499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:11:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6ab98245-1155-47c9-b83a-2e64bcd7abd5 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638" status: 200 len: 1488 microversion: 2.1 time: 0.182008 Apr 11 18:11:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 48/136] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:11:56 2023] GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 => generated 1488 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:11:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}, {"server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "name": "network-vif-unplugged", "status": "completed", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}, {"server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "name": "network-vif-plugged", "status": "completed", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:11:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Creating event network-vif-unplugged:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:11:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Creating event network-vif-plugged:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:11:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035785 Apr 11 18:11:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:57 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce16e1aa-f16b-40be-945a-78265fb23638", "name": "network-vif-deleted", "tag": "8e220357-3dfe-4e09-a0d7-2a3f519a9971"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] Creating event network-vif-deleted:8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance ce16e1aa-f16b-40be-945a-78265fb23638 on user Apr 11 18:11:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037493 Apr 11 18:11:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:11:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}, {"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:11:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:11:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:11:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:11:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:11:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:11:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030576 Apr 11 18:11:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 49/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b14d1177-4790-4a6e-9746-66fe5c84faf4"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-450104ac-53f5-483c-82c6-67f5a73b00fb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.087306 Apr 11 18:12:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 47/140] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:12:00 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-interface => generated 282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538240 Apr 11 18:12:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 45/141] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:12:00 2023] POST /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Creating event network-changed:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:12:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034599 Apr 11 18:12:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 50/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-709617318"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.792182 Apr 11 18:12:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 48/143] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:12:01 2023] POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 18:12:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5d751ac9-8676-4655-9fc9-7e7c721f64ed tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '.version_select at 0x7fadb9bde9e0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5d751ac9-8676-4655-9fc9-7e7c721f64ed tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c" status: 200 len: 1608 microversion: 2.1 time: 0.059926 Apr 11 18:12:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 46/144] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 18:12:02 2023] GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c => generated 1608 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-33c0f0ba-176f-460a-b0d4-696121c334f8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.132317 Apr 11 18:12:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 51/145] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:12:06 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-interface => generated 283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Creating event network-changed:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Apr 11 18:12:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 49/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:12:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 204 len: 0 microversion: 2.1 time: 0.124568 Apr 11 18:12:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 52/147] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:12:08 2023] DELETE /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:12:08 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f6d4c362-dc14-433c-b0cb-90234d63a45c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1537 microversion: 2.1 time: 0.293537 Apr 11 18:12:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 47/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:08 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1537 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:08 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:08 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fd5ab7a54de4c7eae01368522ec9b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972a578943144e9d8b27c8c1367a7ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ea1a76b7-d051-411f-af0a-681cc58c52b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1537 microversion: 2.1 time: 0.270046 Apr 11 18:12:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 53/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:08 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:12:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-320e3d21-55ad-4833-b330-351f4b7c3bf8 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 200 len: 1542 microversion: 2.1 time: 0.300407 Apr 11 18:12:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:08 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 1542 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "name": "network-vif-deleted", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "name": "network-vif-unplugged", "status": "completed", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}, {"server_uuid": "b35fb527-2e5c-449f-a5d5-339595f3dc75", "name": "network-vif-plugged", "status": "completed", "tag": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] Creating event network-vif-deleted:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:12:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037852 Apr 11 18:12:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 48/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Creating event network-vif-unplugged:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:12:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Creating event network-vif-plugged:77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance b35fb527-2e5c-449f-a5d5-339595f3dc75 on user Apr 11 18:12:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.041848 Apr 11 18:12:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 54/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:11 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-82292e60-ad51-435a-b1cd-e4adeb03452f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1536 microversion: 2.1 time: 0.144915 Apr 11 18:12:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:11 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1536 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=13 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:17 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ef99f5b3-ecf1-4926-99d3-1570b3033016 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.090768 Apr 11 18:12:17 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 49/154] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:12:17 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-interface => generated 283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:18 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b510b039-4a22-414a-b3ef-e53008796f9b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.114981 Apr 11 18:12:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 55/155] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:12:18 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:18 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Creating event network-changed:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:12:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 Apr 11 18:12:18 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f821ed7e-c1a1-4b28-a3da-7e2ce97b4139"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:18 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262283 Apr 11 18:12:18 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 50/157] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:12:18 2023] POST /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:20 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Creating event network-changed:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:12:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032702 Apr 11 18:12:20 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 56/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecc81a75-b271-47fd-b9ae-26654e484252"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299580 Apr 11 18:12:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:12:21 2023] POST /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "464a3453-7243-4090-9e1d-855d6921a83b"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" status: 202 len: 0 microversion: 2.1 time: 0.515070 Apr 11 18:12:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 51/160] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 18:12:25 2023] PUT /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-7cb747bc-3344-4dac-b20c-087af6d3eba3 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.088427 Apr 11 18:12:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 57/161] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:12:28 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d2d0c2f7-2dec-4039-97a4-c8e8c397876b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051138 Apr 11 18:12:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:29 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:30 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'services' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Creating event network-changed:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030540 Apr 11 18:12:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 58/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments/ecc81a75-b271-47fd-b9ae-26654e484252" status: 202 len: 0 microversion: 2.1 time: 0.262480 Apr 11 18:12:30 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 52/164] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:12:29 2023] DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments/ecc81a75-b271-47fd-b9ae-26654e484252 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:30 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0234833a-3a9b-4702-bbb4-5ccfe447e504 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 200 len: 1628 microversion: 2.49 time: 0.223549 Apr 11 18:12:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:12:30 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 1628 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "tag": "nic-tag"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:32 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Creating event network-changed:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045832 Apr 11 18:12:32 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 53/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7fc3ffd9-18b0-41db-b4e0-bf4547c553c7 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066404 Apr 11 18:12:33 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:33 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bf6bdb46-f0bf-4d5d-b5bf-8de3bfa28d7b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085296 Apr 11 18:12:33 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 54/168] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:33 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:33 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:12:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 204 len: 0 microversion: 2.1 time: 0.290561 Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:12:33 2023] DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Creating event network-vif-plugged:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:34 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061266 Apr 11 18:12:34 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 55/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface" status: 200 len: 283 microversion: 2.49 time: 4.287266 Apr 11 18:12:34 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 59/171] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 18:12:30 2023] POST /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface => generated 283 bytes in 4290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4420439e-98b5-4fb2-96c9-d2d63151998d", "tag": "volume-tag"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6375313b85465aa965faf4b75eec5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181392922e741a784b8a0d59ca79f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-624a6008-32f9-47f7-9910-107190c4cc1b tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 200 len: 1672 microversion: 2.1 time: 0.650072 Apr 11 18:12:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:34 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 1672 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "name": "network-vif-unplugged", "status": "completed", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Creating event network-vif-unplugged:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:12:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086232 Apr 11 18:12:35 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 60/173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.487707 Apr 11 18:12:35 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 56/174] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 18:12:34 2023] POST /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:12:36 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:36 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Creating event network-vif-plugged:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:36 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059872 Apr 11 18:12:36 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "name": "network-vif-plugged", "status": "completed", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}, {"server_uuid": "67cf8e45-399b-4709-a994-15daf849132a", "name": "network-vif-deleted", "tag": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Creating event network-vif-plugged:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:12:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Creating event network-vif-deleted:83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance 67cf8e45-399b-4709-a994-15daf849132a on user Apr 11 18:12:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030066 Apr 11 18:12:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 61/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5a54bda8-f538-4e55-9096-d11534e14dc8 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080772 Apr 11 18:12:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 57/177] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:37 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:38 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-62befa92-ae90-4751-a2e7-e3fef728910d tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082458 Apr 11 18:12:38 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:37 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f821ed7e-c1a1-4b28-a3da-7e2ce97b4139"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/464a3453-7243-4090-9e1d-855d6921a83b" status: 202 len: 0 microversion: 2.1 time: 0.328755 Apr 11 18:12:38 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 62/179] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 18:12:38 2023] PUT /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/464a3453-7243-4090-9e1d-855d6921a83b => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:43 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'services' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:12:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments/4420439e-98b5-4fb2-96c9-d2d63151998d" status: 202 len: 0 microversion: 2.49 time: 0.196361 Apr 11 18:12:43 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 58/180] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 18:12:43 2023] DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments/4420439e-98b5-4fb2-96c9-d2d63151998d => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:44 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a08fbd6b-a4fb-4dbe-a415-ae5e56bb7a22 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 200 len: 1490 microversion: 2.1 time: 0.212474 Apr 11 18:12:44 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:44 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 1490 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] HTTP exception thrown: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Request method failure captured: Apr 11 18:12:46 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 HTTP/1.1 Apr 11 18:12:46 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:12:46 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:12:46 user devstack@n-api.service[72344]: Connection: close Apr 11 18:12:46 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:12:46 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:12:46 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:12:46 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:12:46 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJvHWqsg8rvomyDMuxpRXFH9yiIoDHLAcSIPcBwAhKEv73hRbsLBjr2kbcHoGPFHuQwLteiTGJShM94fZqPY-9k6zVLQmGsTA6b2b0WodjRIU2O6pmD0XxNGKYBsvDihkVXGXQTrbQuaHTu2xaKcSHjQiszW2asbH9jqb7L6BAsro4 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Project-Id: ba695867a2a94155820b99174b93499b Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Project-Name: tempest-VolumesActionsTest-1624489732 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba695867a2a94155820b99174b93499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba695867a2a94155820b99174b93499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba695867a2a94155820b99174b93499b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Tenant: tempest-VolumesActionsTest-1624489732 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Tenant-Id: ba695867a2a94155820b99174b93499b Apr 11 18:12:46 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-VolumesActionsTest-1624489732 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-User: tempest-VolumesActionsTest-1624489732-project-member Apr 11 18:12:46 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:12:46 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:12:46 user devstack@n-api.service[72344]: X-User-Id: 20dbffe38f4e4be08599eb1f2fa2bc38 Apr 11 18:12:46 user devstack@n-api.service[72344]: X-User-Name: tempest-VolumesActionsTest-1624489732-project-member Apr 11 18:12:46 user devstack@n-api.service[72344]: method: > Apr 11 18:12:46 user devstack@n-api.service[72344]: exception: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. Apr 11 18:12:46 user devstack@n-api.service[72344]: action_args: {'id': 'ce16e1aa-f16b-40be-945a-78265fb23638'} Apr 11 18:12:46 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. Apr 11 18:12:46 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Returning 404 to user: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:12:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-901e0721-5c39-4a2c-8fde-6545dcd2a938 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638" status: 404 len: 111 microversion: 2.1 time: 0.040853 Apr 11 18:12:46 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 63/182] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:46 2023] GET /compute/v2.1/servers/ce16e1aa-f16b-40be-945a-78265fb23638 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface/5a748b88-931b-4127-848e-b4f2255cd805" status: 202 len: 0 microversion: 2.49 time: 0.079550 Apr 11 18:12:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 59/183] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 18:12:46 2023] DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-interface/5a748b88-931b-4127-848e-b4f2255cd805 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-60a5a27d-e581-4c61-b708-ed27f0448388 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.223312 Apr 11 18:12:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 64/184] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:12:46 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07/os-interface => generated 1830 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b5bd328f-ac26-4f6e-b959-ac050b81c2ef tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6" status: 200 len: 474 microversion: 2.49 time: 0.388648 Apr 11 18:12:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 62/185] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 18:12:46 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6 => generated 474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:12:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-20ca948d-5a91-4328-a8c5-2450e6474a10 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.298552 Apr 11 18:12:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 60/186] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:12:47 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf/os-interface => generated 1830 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-unplugged", "status": "completed", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Creating event network-vif-unplugged:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054467 Apr 11 18:12:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 65/187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-deleted", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Creating event network-vif-deleted:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036408 Apr 11 18:12:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=24 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Creating event network-changed:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045372 Apr 11 18:12:49 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 61/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=24 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-027a2a9a-57c4-4401-8020-e0914b833686 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 200 len: 2818 microversion: 2.32 time: 0.410586 Apr 11 18:12:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 66/190] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:12:49 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 2818 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-33345d65-eecb-42a6-83fb-58320b66110a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 200 len: 2829 microversion: 2.42 time: 0.387852 Apr 11 18:12:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 64/191] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:12:49 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 2829 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f7e19ddf-708c-41d4-9150-3b743696bede tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.185266 Apr 11 18:12:49 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 62/192] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:12:49 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf/os-interface => generated 1830 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ca9bdb5d-9315-479e-8d1b-010216dcb705 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.196586 Apr 11 18:12:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 67/193] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:12:49 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07/os-interface => generated 1830 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "5a748b88-931b-4127-848e-b4f2255cd805"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Creating event network-vif-plugged:5a748b88-931b-4127-848e-b4f2255cd805 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:12:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044271 Apr 11 18:12:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-15ac1114-5ae1-4563-8fbf-1a631861220a tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Apr 11 18:12:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 63/195] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:50 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-67923ddf-e762-413e-ba17-2faf9635b128 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Apr 11 18:12:50 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 68/196] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:50 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'services' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:12:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" status: 202 len: 0 microversion: 2.1 time: 0.243665 Apr 11 18:12:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:12:50 2023] DELETE /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments/f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d9bc7cde-ca64-4556-a5bf-e188d5843811 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Apr 11 18:12:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 64/198] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:50 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:12:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Creating event network-changed:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030152 Apr 11 18:12:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 67/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:12:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 204 len: 0 microversion: 2.32 time: 0.124638 Apr 11 18:12:50 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 69/200] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:12:50 2023] DELETE /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 204 len: 0 microversion: 2.42 time: 0.160662 Apr 11 18:12:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 65/201] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:12:50 2023] DELETE /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:51 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-84399662-5e78-4246-8de8-748685affdd5 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 200 len: 2943 microversion: 2.32 time: 0.340521 Apr 11 18:12:51 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 68/202] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:12:50 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 2943 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:51 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3d960aed-7a30-42f2-9544-a3a4d38661a5 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 200 len: 2835 microversion: 2.42 time: 0.339586 Apr 11 18:12:51 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 70/203] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:12:51 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 2835 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:12:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Creating event network-vif-unplugged:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031338 Apr 11 18:12:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 66/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Creating event network-vif-unplugged:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043552 Apr 11 18:12:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-eadd0b8d-f507-4f60-a1ec-d2709a417eca tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '.version_select at 0x7fadb99b6c20>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:52 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-eadd0b8d-f507-4f60-a1ec-d2709a417eca tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c" status: 200 len: 1722 microversion: 2.1 time: 0.097260 Apr 11 18:12:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 71/206] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 18:12:52 2023] GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c => generated 1722 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Creating event network-vif-unplugged:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Creating event network-vif-plugged:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051723 Apr 11 18:12:52 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 67/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9092b485-0e29-4a51-bfbc-f2c53f120c19 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '.version_select at 0x7fadb9ab44c0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9092b485-0e29-4a51-bfbc-f2c53f120c19 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c" status: 200 len: 1722 microversion: 2.1 time: 0.079970 Apr 11 18:12:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 70/208] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 18:12:52 2023] GET /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c => generated 1722 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:53 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:53 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-876b312c-2bbd-4219-8ad2-360c3c5edd2a tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1670 microversion: 2.1 time: 0.217888 Apr 11 18:12:53 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 72/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:53 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Creating event network-vif-plugged:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Creating event network-vif-unplugged:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Creating event network-vif-plugged:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Creating event network-vif-unplugged:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Creating event network-vif-plugged:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.032651 Apr 11 18:12:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 68/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "903ba719-5693-44ed-985d-74770767b6c5"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "903ba719-5693-44ed-985d-74770767b6c5"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "218012bb-cbbd-412d-85af-8c76ac2c273d"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "218012bb-cbbd-412d-85af-8c76ac2c273d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "cec9b7a9-6277-4820-8c0b-0fb252127d98"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "cec9b7a9-6277-4820-8c0b-0fb252127d98"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-plugged:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-unplugged:903ba719-5693-44ed-985d-74770767b6c5 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-plugged:903ba719-5693-44ed-985d-74770767b6c5 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-unplugged:218012bb-cbbd-412d-85af-8c76ac2c273d for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-plugged:218012bb-cbbd-412d-85af-8c76ac2c273d for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-unplugged:cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Creating event network-vif-plugged:cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.046851 Apr 11 18:12:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 71/211] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 18:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-plugged", "status": "completed", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-unplugged", "status": "completed", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-plugged:9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-plugged:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-plugged:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-plugged:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-plugged:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Creating event network-vif-unplugged:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1905 microversion: 2.1 time: 0.047990 Apr 11 18:12:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 73/212] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 18:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 1905 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] HTTP exception thrown: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Request method failure captured: Apr 11 18:12:58 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 HTTP/1.1 Apr 11 18:12:58 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:12:58 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:12:58 user devstack@n-api.service[72345]: Connection: close Apr 11 18:12:58 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:12:58 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:12:58 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:12:58 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:12:58 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJ-Uz_4LFoUcs28sg7dn3WBwSJjsfzs96BoOIVjTRD1f8GqKrhX4CRJvnhuejnXV4ZhMyVSJr2i2iU8ybdG1xnd3eBUDOV0sZpRNDtXjWlVpMvYYKyUenIHxsT3I3rpOIXeli4J6qmbEd4LJMNYKKoaNBQrrb6c0cggkoZZmUDgcU4 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Project-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Project-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Tenant: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Tenant-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72345]: X-User: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:12:58 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:12:58 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:12:58 user devstack@n-api.service[72345]: X-User-Id: 5fd5ab7a54de4c7eae01368522ec9b6f Apr 11 18:12:58 user devstack@n-api.service[72345]: X-User-Name: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:12:58 user devstack@n-api.service[72345]: method: > Apr 11 18:12:58 user devstack@n-api.service[72345]: exception: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72345]: action_args: {'id': 'b35fb527-2e5c-449f-a5d5-339595f3dc75'} Apr 11 18:12:58 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Returning 404 to user: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:12:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b35f8599-95c4-46a2-bc01-85699f214b65 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 404 len: 111 microversion: 2.1 time: 0.040326 Apr 11 18:12:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:58 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-plugged", "status": "completed", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Creating event network-vif-plugged:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035293 Apr 11 18:12:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 74/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-deleted", "tag": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] Creating event network-vif-deleted:eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:12:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Apr 11 18:12:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:12:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] HTTP exception thrown: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Request method failure captured: Apr 11 18:12:58 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75/os-volume_attachments HTTP/1.1 Apr 11 18:12:58 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:12:58 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:12:58 user devstack@n-api.service[72344]: Connection: close Apr 11 18:12:58 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:12:58 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:12:58 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:12:58 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:12:58 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ-Uz_4LFoUcs28sg7dn3WBwSJjsfzs96BoOIVjTRD1f8GqKrhX4CRJvnhuejnXV4ZhMyVSJr2i2iU8ybdG1xnd3eBUDOV0sZpRNDtXjWlVpMvYYKyUenIHxsT3I3rpOIXeli4J6qmbEd4LJMNYKKoaNBQrrb6c0cggkoZZmUDgcU4 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Project-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Project-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Tenant: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Tenant-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:12:58 user devstack@n-api.service[72344]: X-User: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:12:58 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:12:58 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:12:58 user devstack@n-api.service[72344]: X-User-Id: 5fd5ab7a54de4c7eae01368522ec9b6f Apr 11 18:12:58 user devstack@n-api.service[72344]: X-User-Name: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:12:58 user devstack@n-api.service[72344]: method: > Apr 11 18:12:58 user devstack@n-api.service[72344]: exception: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72344]: action_args: {'server_id': 'b35fb527-2e5c-449f-a5d5-339595f3dc75'} Apr 11 18:12:58 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:12:58 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:12:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Returning 404 to user: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:12:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-89b14048-3a27-4ae8-9c97-d3b27af47800 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036490 Apr 11 18:12:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 75/216] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:12:58 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:12:59 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a5db3080-e18b-4cce-b75b-518f2ea84fc4 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1656 microversion: 2.1 time: 0.468982 Apr 11 18:12:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 69/217] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:58 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1656 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:12:59 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:12:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b79c9c3c-f72c-4a53-944b-e4e7e30054f2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1656 microversion: 2.1 time: 0.214442 Apr 11 18:12:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:12:59 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1656 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] HTTP exception thrown: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Request method failure captured: Apr 11 18:13:00 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 HTTP/1.1 Apr 11 18:13:00 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:00 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:00 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:00 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:00 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:00 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:00 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:00 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ-Uz_4LFoUcs28sg7dn3WBwSJjsfzs96BoOIVjTRD1f8GqKrhX4CRJvnhuejnXV4ZhMyVSJr2i2iU8ybdG1xnd3eBUDOV0sZpRNDtXjWlVpMvYYKyUenIHxsT3I3rpOIXeli4J6qmbEd4LJMNYKKoaNBQrrb6c0cggkoZZmUDgcU4 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Project-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Project-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Tenant: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Tenant-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72344]: X-User: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:13:00 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:00 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:00 user devstack@n-api.service[72344]: X-User-Id: 5fd5ab7a54de4c7eae01368522ec9b6f Apr 11 18:13:00 user devstack@n-api.service[72344]: X-User-Name: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:13:00 user devstack@n-api.service[72344]: method: > Apr 11 18:13:00 user devstack@n-api.service[72344]: exception: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72344]: action_args: {'id': 'b35fb527-2e5c-449f-a5d5-339595f3dc75'} Apr 11 18:13:00 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Returning 404 to user: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ace030fb-66e9-4daa-b7c1-a89d185f03cd tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 404 len: 111 microversion: 2.1 time: 0.037079 Apr 11 18:13:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 76/219] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:13:00 2023] DELETE /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] HTTP exception thrown: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Request method failure captured: Apr 11 18:13:00 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 HTTP/1.1 Apr 11 18:13:00 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:13:00 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:13:00 user devstack@n-api.service[72343]: Connection: close Apr 11 18:13:00 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:13:00 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:13:00 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:13:00 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:13:00 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ-Uz_4LFoUcs28sg7dn3WBwSJjsfzs96BoOIVjTRD1f8GqKrhX4CRJvnhuejnXV4ZhMyVSJr2i2iU8ybdG1xnd3eBUDOV0sZpRNDtXjWlVpMvYYKyUenIHxsT3I3rpOIXeli4J6qmbEd4LJMNYKKoaNBQrrb6c0cggkoZZmUDgcU4 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Project-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Project-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/972a578943144e9d8b27c8c1367a7ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Tenant: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Tenant-Id: 972a578943144e9d8b27c8c1367a7ab0 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-DeleteServersTestJSON-1250553535 Apr 11 18:13:00 user devstack@n-api.service[72343]: X-User: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:13:00 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:13:00 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:13:00 user devstack@n-api.service[72343]: X-User-Id: 5fd5ab7a54de4c7eae01368522ec9b6f Apr 11 18:13:00 user devstack@n-api.service[72343]: X-User-Name: tempest-DeleteServersTestJSON-1250553535-project-member Apr 11 18:13:00 user devstack@n-api.service[72343]: method: > Apr 11 18:13:00 user devstack@n-api.service[72343]: exception: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72343]: action_args: {'id': 'b35fb527-2e5c-449f-a5d5-339595f3dc75'} Apr 11 18:13:00 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. Apr 11 18:13:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Returning 404 to user: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-db1df369-293a-44e0-abf0-bbbc778d043a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75" status: 404 len: 111 microversion: 2.1 time: 0.048506 Apr 11 18:13:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 70/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:00 2023] GET /compute/v2.1/servers/b35fb527-2e5c-449f-a5d5-339595f3dc75 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-deleted", "tag": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-deleted", "tag": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:00 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Creating event network-vif-deleted:8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:13:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] Creating event network-vif-deleted:9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:13:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031059 Apr 11 18:13:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-deleted", "tag": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-deleted", "tag": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa"}, {"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-deleted", "tag": "ced10f2e-f2b3-49c0-9232-989b3cc110e0"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Creating event network-vif-deleted:5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:13:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Creating event network-vif-deleted:ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:13:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] Creating event network-vif-deleted:ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:13:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031036 Apr 11 18:13:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 77/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-deleted", "tag": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a"}, {"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-deleted", "tag": "7abbaabc-4691-4bea-975e-632d04d0983d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Creating event network-vif-deleted:9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:13:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] Creating event network-vif-deleted:7abbaabc-4691-4bea-975e-632d04d0983d for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:13:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038074 Apr 11 18:13:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 71/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd86b2f4-002e-48ab-987c-b081681b5e07", "name": "network-vif-deleted", "tag": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] Creating event network-vif-deleted:cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance cd86b2f4-002e-48ab-987c-b081681b5e07 on user Apr 11 18:13:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036905 Apr 11 18:13:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aedb5f4-32cf-497c-8035-0f694cbf78cf", "name": "network-vif-deleted", "tag": "11876d87-cfbc-4d1e-84aa-62d927337a20"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] Creating event network-vif-deleted:11876d87-cfbc-4d1e-84aa-62d927337a20 for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf on user Apr 11 18:13:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Apr 11 18:13:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 78/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5cdf25de-5414-4f06-b732-36e38c950b8b tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Action: 'create', calling method: .version_select at 0x7fadb98b6710>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-157087029", "metadata": {"Type": "work"}}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5cdf25de-5414-4f06-b732-36e38c950b8b tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.530840 Apr 11 18:13:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 72/226] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 18:13:06 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 533 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 18:13:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-567ed449-2763-4cff-93ac-af0c4e728795 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb9cc3e20>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-567ed449-2763-4cff-93ac-af0c4e728795 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 200 len: 352 microversion: 2.1 time: 0.059915 Apr 11 18:13:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:07 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d3cfcbcb-db98-4e65-bff7-c38bf952f258 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb9831b40>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d3cfcbcb-db98-4e65-bff7-c38bf952f258 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 200 len: 353 microversion: 2.1 time: 0.050818 Apr 11 18:13:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 79/228] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:08 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6d618398-fd3e-4aa2-a35d-68c070897ba6 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb98b7640>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6d618398-fd3e-4aa2-a35d-68c070897ba6 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 200 len: 353 microversion: 2.1 time: 0.061156 Apr 11 18:13:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 73/229] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:08 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2484fab7-2544-4d3f-8fd9-14bfb518a5c4 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb999b370>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-2484fab7-2544-4d3f-8fd9-14bfb518a5c4 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 202 len: 0 microversion: 2.1 time: 0.075590 Apr 11 18:13:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:13:08 2023] DELETE /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:13:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b544e21e-6460-449e-9edb-377505bcd63f tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb9831a20>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b544e21e-6460-449e-9edb-377505bcd63f tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 200 len: 352 microversion: 2.1 time: 0.046949 Apr 11 18:13:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 80/231] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:08 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3efcb571-8b3b-4e99-9dfa-a94932724015 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadb9a6b7f0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3efcb571-8b3b-4e99-9dfa-a94932724015 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 200 len: 352 microversion: 2.1 time: 0.068615 Apr 11 18:13:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 74/232] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:09 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dbe16380-53c1-4fcb-8f21-f20f6ed0f379 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Calling method '.version_select at 0x7fadbb0b92d0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-dbe16380-53c1-4fcb-8f21-f20f6ed0f379 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] HTTP exception thrown: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. Apr 11 18:13:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dbe16380-53c1-4fcb-8f21-f20f6ed0f379 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Request method failure captured: Apr 11 18:13:10 user devstack@n-api.service[72345]: request: GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 HTTP/1.1 Apr 11 18:13:10 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:13:10 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:13:10 user devstack@n-api.service[72345]: Connection: close Apr 11 18:13:10 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:13:10 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:13:10 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:13:10 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:13:10 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaMybmobSCJtcGPYXjY23eH0Lsj8d6Awv9dhHkDoq_6NHR7wi-2-86CWAzMXkqnLyIdN1deo5D8rCWrpwr_sA91a_nLHv9FzOvnRWjjWQNGzBKM_wAiQLRf-AC4WL2XuGtcImnky0rKLi-qzHHOtbA6Ixk8qcg8RlsYxoVushmS-WoY Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Project-Id: ae33bc3cdbee41d283ef2eb338141fb3 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesGetTestJSON-1574883921 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae33bc3cdbee41d283ef2eb338141fb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae33bc3cdbee41d283ef2eb338141fb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae33bc3cdbee41d283ef2eb338141fb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesGetTestJSON-1574883921 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Tenant-Id: ae33bc3cdbee41d283ef2eb338141fb3 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesGetTestJSON-1574883921 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-User: tempest-VolumesGetTestJSON-1574883921-project-member Apr 11 18:13:10 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:13:10 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:13:10 user devstack@n-api.service[72345]: X-User-Id: 0a4a9a67d2fb4faeadf4e117e12bcc00 Apr 11 18:13:10 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesGetTestJSON-1574883921-project-member Apr 11 18:13:10 user devstack@n-api.service[72345]: method: Apr 11 18:13:10 user devstack@n-api.service[72345]: exception: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. Apr 11 18:13:10 user devstack@n-api.service[72345]: action_args: {'id': '7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0'} Apr 11 18:13:10 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. (HTTP 404) (Request-ID: req-60b92753-c5fa-4959-9aef-7496dfa801c1) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. Apr 11 18:13:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dbe16380-53c1-4fcb-8f21-f20f6ed0f379 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] Returning 404 to user: Volume 7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-dbe16380-53c1-4fcb-8f21-f20f6ed0f379 tempest-VolumesGetTestJSON-1574883921 tempest-VolumesGetTestJSON-1574883921-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0" status: 404 len: 109 microversion: 2.1 time: 0.041222 Apr 11 18:13:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:13:10 2023] GET /compute/v2.1/os-volumes/7a1ab1ef-a034-4284-9eb6-448e4d5c0bc0 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:11 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e3c323bd-abef-46dd-a862-14c81225498d tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1536 microversion: 2.1 time: 0.176628 Apr 11 18:13:11 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 81/234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:11 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1536 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching by: {'deleted': False, 'project_id': 'a70e133c013140e1a17804737f4e3ef7'} {{(pid=72343) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:12 user devstack@n-api.service[72343]: DEBUG nova.compute.multi_cell_list [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 18:13:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8aa9945b-8520-4bd3-b5c5-427b83600d9e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.186065 Apr 11 18:13:12 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 75/235] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 18:13:11 2023] GET /compute/v2.1/servers => generated 340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:12 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c1e9222d-de3d-4536-92f9-31890a4911d1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1536 microversion: 2.1 time: 0.149008 Apr 11 18:13:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:12 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1536 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66e98e6d-f7ea-48df-a28b-c9148c90317e"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275435 Apr 11 18:13:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 82/237] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:13:13 2023] POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-38d9e225-0a9a-449d-a9fe-fbc8b93f4370 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Action: 'create', calling method: .version_select at 0x7fadb9a6b7f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1371472427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJoEwkISzTf/Xl7bcqN5WFtK8IzBxrVabbCuw9Mu4MRtB0G1QNlNr8PwZepxAvxrQAcbqFk6TTH2cZjSmdlEbyBSzPwALnwMfNcWaTDuhhOtxF38FYCkmUerlI+JQ1TEg=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:19 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-38d9e225-0a9a-449d-a9fe-fbc8b93f4370 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting quotas for project 6090bfb65d0c4afeb5ac38c45083799d. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:13:19 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-38d9e225-0a9a-449d-a9fe-fbc8b93f4370 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting quotas for user 43dc7c5c888247029ff6adedbdb2e938 and project 6090bfb65d0c4afeb5ac38c45083799d. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:13:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-38d9e225-0a9a-449d-a9fe-fbc8b93f4370 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252092 Apr 11 18:13:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 76/238] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:13:19 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:22 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d37191a7-ab6b-4422-a697-2c69c0346b63 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1582 microversion: 2.1 time: 0.275481 Apr 11 18:13:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:22 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1582 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:22 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1554900069", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1371472427", "security_groups": [{"name": "tempest-secgroup-smoke-1956913157"}], "networks": [{"uuid": "72ea9f23-84b0-4068-a61e-020436d38b6f"}], "block_device_mapping_v2": [{"uuid": "c2cc9035-772b-48ee-8fd4-b89cd9319142", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:22 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:22 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] validate_networks() for [('72ea9f23-84b0-4068-a61e-020436d38b6f', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting quotas for project 6090bfb65d0c4afeb5ac38c45083799d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting quotas for user 43dc7c5c888247029ff6adedbdb2e938 and project 6090bfb65d0c4afeb5ac38c45083799d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:13:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2cc9035-772b-48ee-8fd4-b89cd9319142',volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:13:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.215132 Apr 11 18:13:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 83/240] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:13:22 2023] POST /compute/v2.1/servers => generated 404 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:13:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5b2e4129-e987-4292-a1b9-5c4f47d54b30 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:23 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5b2e4129-e987-4292-a1b9-5c4f47d54b30 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:23 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-5b2e4129-e987-4292-a1b9-5c4f47d54b30 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5b2e4129-e987-4292-a1b9-5c4f47d54b30 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1084 microversion: 2.1 time: 0.077300 Apr 11 18:13:23 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 77/241] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:23 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1084 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:24 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:24 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Creating event network-changed:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:24 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Apr 11 18:13:24 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 82/242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] HTTP exception thrown: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Request method failure captured: Apr 11 18:13:24 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a HTTP/1.1 Apr 11 18:13:24 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:24 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:24 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:24 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:24 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:24 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:24 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:24 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJtY7xUBORwaedwYQC8YP5q-1DL8r6cc6iwmRCoJ3j4Rq6-bnDTUcOgdkZoX5SbmGwjSJN74NyMvFBG4CFOkjS_QPwGGRin6b2LbAwd36X2Kayqwv16hiNuQXLHWaBsldLYASoEZawfmnazwJ2XqjgtYFdeokdNFPBlI5st6yyWOIs Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Project-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Tenant-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:24 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:24 user devstack@n-api.service[72344]: X-User: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:24 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:24 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:24 user devstack@n-api.service[72344]: X-User-Id: 9b6375313b85465aa965faf4b75eec5c Apr 11 18:13:24 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:24 user devstack@n-api.service[72344]: method: > Apr 11 18:13:24 user devstack@n-api.service[72344]: exception: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:24 user devstack@n-api.service[72344]: action_args: {'id': '67cf8e45-399b-4709-a994-15daf849132a'} Apr 11 18:13:24 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:24 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Returning 404 to user: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-35d01c0e-bb15-46a1-b72e-5ede09c9b695 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 404 len: 111 microversion: 2.1 time: 0.047755 Apr 11 18:13:24 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 84/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:24 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-65d07e6a-8e5e-49af-8a63-f94e0e3018a2 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '.version_select at 0x7fadb98b7400>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-65d07e6a-8e5e-49af-8a63-f94e0e3018a2 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752484616" status: 202 len: 0 microversion: 2.1 time: 0.025330 Apr 11 18:13:24 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 78/244] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:13:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752484616 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1032118760"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:26 user devstack@n-api.service[72345]: INFO nova.network.security_group_api [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Adding security group 4324e722-d73f-4702-bd09-ee47f830ed64 to port 9f1432e1-1448-4815-a940-c004344002a0 Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] HTTP exception thrown: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Request method failure captured: Apr 11 18:13:27 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a HTTP/1.1 Apr 11 18:13:27 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:27 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:27 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:27 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:27 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:27 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:27 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:27 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJtY7xUBORwaedwYQC8YP5q-1DL8r6cc6iwmRCoJ3j4Rq6-bnDTUcOgdkZoX5SbmGwjSJN74NyMvFBG4CFOkjS_QPwGGRin6b2LbAwd36X2Kayqwv16hiNuQXLHWaBsldLYASoEZawfmnazwJ2XqjgtYFdeokdNFPBlI5st6yyWOIs Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Project-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Tenant-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:27 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72344]: X-User: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:27 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:27 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:27 user devstack@n-api.service[72344]: X-User-Id: 9b6375313b85465aa965faf4b75eec5c Apr 11 18:13:27 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:27 user devstack@n-api.service[72344]: method: > Apr 11 18:13:27 user devstack@n-api.service[72344]: exception: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72344]: action_args: {'id': '67cf8e45-399b-4709-a994-15daf849132a'} Apr 11 18:13:27 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Returning 404 to user: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0c0049d3-1b15-44eb-877f-97a41394af5f tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 404 len: 111 microversion: 2.1 time: 0.041950 Apr 11 18:13:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 85/245] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:13:27 2023] DELETE /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] HTTP exception thrown: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Request method failure captured: Apr 11 18:13:27 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a HTTP/1.1 Apr 11 18:13:27 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:13:27 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:13:27 user devstack@n-api.service[72343]: Connection: close Apr 11 18:13:27 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:13:27 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:13:27 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:13:27 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:13:27 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJtY7xUBORwaedwYQC8YP5q-1DL8r6cc6iwmRCoJ3j4Rq6-bnDTUcOgdkZoX5SbmGwjSJN74NyMvFBG4CFOkjS_QPwGGRin6b2LbAwd36X2Kayqwv16hiNuQXLHWaBsldLYASoEZawfmnazwJ2XqjgtYFdeokdNFPBlI5st6yyWOIs Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Project-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b181392922e741a784b8a0d59ca79f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Tenant-Id: b181392922e741a784b8a0d59ca79f7f Apr 11 18:13:27 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1972641769 Apr 11 18:13:27 user devstack@n-api.service[72343]: X-User: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:27 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:13:27 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:13:27 user devstack@n-api.service[72343]: X-User-Id: 9b6375313b85465aa965faf4b75eec5c Apr 11 18:13:27 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1972641769-project-member Apr 11 18:13:27 user devstack@n-api.service[72343]: method: > Apr 11 18:13:27 user devstack@n-api.service[72343]: exception: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72343]: action_args: {'id': '67cf8e45-399b-4709-a994-15daf849132a'} Apr 11 18:13:27 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. Apr 11 18:13:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Returning 404 to user: Instance 67cf8e45-399b-4709-a994-15daf849132a could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-006d48bd-92c5-497e-a396-e6abb0cc370a tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a" status: 404 len: 111 microversion: 2.1 time: 0.038975 Apr 11 18:13:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 79/246] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:27 2023] GET /compute/v2.1/servers/67cf8e45-399b-4709-a994-15daf849132a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:13:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ea6576b0-5f38-42e2-9b2d-f763716e7362 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action" status: 202 len: 0 microversion: 2.1 time: 1.070437 Apr 11 18:13:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:13:26 2023] POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Creating event network-changed:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036022 Apr 11 18:13:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 80/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:27 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a58f9423-e661-4d24-99cb-fd5a428aaeb8 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1748 microversion: 2.1 time: 0.250457 Apr 11 18:13:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 86/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:27 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1748 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=28 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action" status: 202 len: 0 microversion: 2.1 time: 0.098078 Apr 11 18:13:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 84/250] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:13:29 2023] POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:29 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d1b9fde1-3b8e-45ae-a69c-e72f0e2b058e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1750 microversion: 2.1 time: 0.306762 Apr 11 18:13:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 81/251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:29 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1750 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Creating event network-changed:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:13:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030497 Apr 11 18:13:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 87/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Creating event network-vif-unplugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038691 Apr 11 18:13:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:32 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:32 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:13:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036854 Apr 11 18:13:32 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 82/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:13:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042916 Apr 11 18:13:34 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 88/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:36 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}, {"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:36 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=16 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:13:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057621 Apr 11 18:13:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f0332715-1666-4d59-899d-985485289bfe tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6" status: 200 len: 503 microversion: 2.49 time: 0.086516 Apr 11 18:13:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 83/257] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 18:13:37 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6 => generated 503 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e0e1b7ff-2673-4456-b17c-a1365810a855 tempest-TaggedAttachmentsTest-1914690377 tempest-TaggedAttachmentsTest-1914690377-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6" status: 200 len: 503 microversion: 2.49 time: 0.099779 Apr 11 18:13:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 89/258] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 18:13:37 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-instance-actions/req-b172b173-c625-4790-83d4-954500dda9a6 => generated 503 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-91d48d63-d2ac-4152-bdf4-d6ef58667982 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.048395 Apr 11 18:13:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 18:13:37 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:13:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 204 len: 0 microversion: 2.49 time: 0.185634 Apr 11 18:13:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 84/260] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:13:37 2023] DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f15fd561-0d1a-4376-b1ce-4fde735264b7 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 200 len: 1753 microversion: 2.49 time: 0.830981 Apr 11 18:13:38 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 90/261] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:13:37 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 1753 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 18:13:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-unplugged", "status": "completed", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}, {"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-plugged", "status": "completed", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Creating event network-vif-unplugged:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:13:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Creating event network-vif-plugged:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:13:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033963 Apr 11 18:13:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:40 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b", "name": "network-vif-deleted", "tag": "8967a8d4-b607-4572-bfc2-50c7663563cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:40 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:40 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] Creating event network-vif-deleted:8967a8d4-b607-4572-bfc2-50c7663563cb for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b on user Apr 11 18:13:40 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033299 Apr 11 18:13:40 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 85/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:40 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b28a757e-9cc2-4e16-be30-a76ef76d7466 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056962 Apr 11 18:13:40 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 91/264] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:13:40 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:13:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585" status: 204 len: 0 microversion: 2.1 time: 0.163175 Apr 11 18:13:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:13:40 2023] DELETE /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HTTP exception thrown: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Request method failure captured: Apr 11 18:13:41 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf HTTP/1.1 Apr 11 18:13:41 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:41 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:41 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:41 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:41 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:41 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:41 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:41 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJyE9PdTFS_R7otSI84rx4X4tDJq53LD-caBAougOdpCCXU-DtV71RmAR3xFfpadaO9rNmo-5OMs2NVnks3Hq8RzS--KLvLyrIZv1DZzZJ0-sgMkn0JtHVUSX4MFtCtvfcHe5pzin5Nd1wqk1JlvGP-Iew-LDBIRVTBoq-_AzhFSgI Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Id: 59738138e8c346a393ea13fe7fadbe88 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Name: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:41 user devstack@n-api.service[72344]: method: > Apr 11 18:13:41 user devstack@n-api.service[72344]: exception: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: action_args: {'id': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'} Apr 11 18:13:41 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Returning 404 to user: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-7abfa24a-2803-495e-bed3-5b8a42197493 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 404 len: 111 microversion: 2.32 time: 0.040618 Apr 11 18:13:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 92/266] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:13:41 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d4a1de4c8e49a0a14eec670db8ff0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19acb9280d2f48b59ad7b2fde0e4efb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-042012e5-764f-44b5-9be4-11ab9c227aad tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '.version_select at 0x7fadb979a950>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d67b1649-096f-4075-92df-a877b4ece396 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585" status: 200 len: 1650 microversion: 2.1 time: 0.290000 Apr 11 18:13:41 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 86/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:41 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 => generated 1650 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HTTP exception thrown: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Request method failure captured: Apr 11 18:13:41 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 HTTP/1.1 Apr 11 18:13:41 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:41 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:41 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:41 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:41 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:41 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:41 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:41 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJwK3qsbHeCx9JsQLeqtPbvebnyN8J_hSVayAzT1FTJ8FP_KbXATl9_ZX06ll_GiuHcWmvoqhETQ-LDy4Nb0_QMftf_k04UqYWAb-T4oOQ-7Zo3VVKpaklde8OLXwxGTDnBOXdbBFIxcSB8zoSPIygBjh0lK8GXLkrbGDrvdBoAXeM Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:41 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Id: 7c63dc594a1a4977b67ccc1a63d09de4 Apr 11 18:13:41 user devstack@n-api.service[72344]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:41 user devstack@n-api.service[72344]: method: > Apr 11 18:13:41 user devstack@n-api.service[72344]: exception: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: action_args: {'id': 'cd86b2f4-002e-48ab-987c-b081681b5e07'} Apr 11 18:13:41 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:41 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Returning 404 to user: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b224b382-51cb-4592-9459-4bf5926663dd tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 404 len: 111 microversion: 2.42 time: 0.038933 Apr 11 18:13:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 93/268] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:13:41 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-042012e5-764f-44b5-9be4-11ab9c227aad tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551663442" status: 204 len: 0 microversion: 2.32 time: 0.077505 Apr 11 18:13:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 90/269] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 18:13:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551663442 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-fd8ee523-2bfc-4f3e-a973-6e41564a808a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '.version_select at 0x7fadb9707eb0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-fd8ee523-2bfc-4f3e-a973-6e41564a808a tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140518670" status: 204 len: 0 microversion: 2.42 time: 0.038728 Apr 11 18:13:41 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 87/270] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 18:13:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140518670 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Creating event network-vif-unplugged:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:13:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039677 Apr 11 18:13:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 94/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:13:43 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "name": "network-vif-deleted", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] Creating event network-vif-deleted:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:13:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Apr 11 18:13:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:43 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c107e5ac-af58-4702-aa62-253f3424c585", "name": "network-vif-plugged", "status": "completed", "tag": "c8a46ee6-74bb-42ed-a653-649dc130b0f3"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Creating event network-vif-plugged:c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance c107e5ac-af58-4702-aa62-253f3424c585 on user Apr 11 18:13:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 Apr 11 18:13:43 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 88/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:45 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-565bc3d5-c0ab-41f1-bbf6-e265fda85baa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1504 microversion: 2.1 time: 0.182510 Apr 11 18:13:45 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 95/274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:44 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HTTP exception thrown: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Request method failure captured: Apr 11 18:13:47 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf HTTP/1.1 Apr 11 18:13:47 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:13:47 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:13:47 user devstack@n-api.service[72345]: Connection: close Apr 11 18:13:47 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:13:47 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:13:47 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:13:47 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:13:47 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJyE9PdTFS_R7otSI84rx4X4tDJq53LD-caBAougOdpCCXU-DtV71RmAR3xFfpadaO9rNmo-5OMs2NVnks3Hq8RzS--KLvLyrIZv1DZzZJ0-sgMkn0JtHVUSX4MFtCtvfcHe5pzin5Nd1wqk1JlvGP-Iew-LDBIRVTBoq-_AzhFSgI Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Id: 59738138e8c346a393ea13fe7fadbe88 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Name: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:47 user devstack@n-api.service[72345]: method: > Apr 11 18:13:47 user devstack@n-api.service[72345]: exception: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: action_args: {'id': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'} Apr 11 18:13:47 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Returning 404 to user: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-25c05daa-4ce7-4850-8f50-273d66178418 tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 404 len: 111 microversion: 2.32 time: 0.031214 Apr 11 18:13:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:13:47 2023] DELETE /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HTTP exception thrown: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Request method failure captured: Apr 11 18:13:47 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf HTTP/1.1 Apr 11 18:13:47 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:13:47 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:13:47 user devstack@n-api.service[72343]: Connection: close Apr 11 18:13:47 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:13:47 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:13:47 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:13:47 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:13:47 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJyE9PdTFS_R7otSI84rx4X4tDJq53LD-caBAougOdpCCXU-DtV71RmAR3xFfpadaO9rNmo-5OMs2NVnks3Hq8RzS--KLvLyrIZv1DZzZJ0-sgMkn0JtHVUSX4MFtCtvfcHe5pzin5Nd1wqk1JlvGP-Iew-LDBIRVTBoq-_AzhFSgI Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Project-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Project-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/661f042c46b14d2184cfaa77200899a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Tenant: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Tenant-Id: 661f042c46b14d2184cfaa77200899a8 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TaggedBootDevicesTest-479213965 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-User: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:47 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72343]: X-User-Id: 59738138e8c346a393ea13fe7fadbe88 Apr 11 18:13:47 user devstack@n-api.service[72343]: X-User-Name: tempest-TaggedBootDevicesTest-479213965-project-member Apr 11 18:13:47 user devstack@n-api.service[72343]: method: > Apr 11 18:13:47 user devstack@n-api.service[72343]: exception: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72343]: action_args: {'id': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'} Apr 11 18:13:47 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. Apr 11 18:13:47 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Returning 404 to user: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-adab8452-a238-4418-96e4-5fa9b24d7ccc tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf" status: 404 len: 111 microversion: 2.32 time: 0.030143 Apr 11 18:13:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 89/276] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:13:47 2023] GET /compute/v2.1/servers/3aedb5f4-32cf-497c-8035-0f694cbf78cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HTTP exception thrown: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Request method failure captured: Apr 11 18:13:47 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 HTTP/1.1 Apr 11 18:13:47 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:13:47 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:13:47 user devstack@n-api.service[72344]: Connection: close Apr 11 18:13:47 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:13:47 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:13:47 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:13:47 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:13:47 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJwK3qsbHeCx9JsQLeqtPbvebnyN8J_hSVayAzT1FTJ8FP_KbXATl9_ZX06ll_GiuHcWmvoqhETQ-LDy4Nb0_QMftf_k04UqYWAb-T4oOQ-7Zo3VVKpaklde8OLXwxGTDnBOXdbBFIxcSB8zoSPIygBjh0lK8GXLkrbGDrvdBoAXeM Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Project-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Tenant-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:47 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-User: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:47 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72344]: X-User-Id: 7c63dc594a1a4977b67ccc1a63d09de4 Apr 11 18:13:47 user devstack@n-api.service[72344]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:47 user devstack@n-api.service[72344]: method: > Apr 11 18:13:47 user devstack@n-api.service[72344]: exception: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72344]: action_args: {'id': 'cd86b2f4-002e-48ab-987c-b081681b5e07'} Apr 11 18:13:47 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Returning 404 to user: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-1d0f2064-8e6d-40ce-9867-18f8ba5e4994 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 404 len: 111 microversion: 2.42 time: 0.058975 Apr 11 18:13:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 96/277] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:13:47 2023] DELETE /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HTTP exception thrown: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Request method failure captured: Apr 11 18:13:47 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 HTTP/1.1 Apr 11 18:13:47 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:13:47 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:13:47 user devstack@n-api.service[72345]: Connection: close Apr 11 18:13:47 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:13:47 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:13:47 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:13:47 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:13:47 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJwK3qsbHeCx9JsQLeqtPbvebnyN8J_hSVayAzT1FTJ8FP_KbXATl9_ZX06ll_GiuHcWmvoqhETQ-LDy4Nb0_QMftf_k04UqYWAb-T4oOQ-7Zo3VVKpaklde8OLXwxGTDnBOXdbBFIxcSB8zoSPIygBjh0lK8GXLkrbGDrvdBoAXeM Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e235e9f2e72e4fc28995bf9716d8e4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant-Id: e235e9f2e72e4fc28995bf9716d8e4ff Apr 11 18:13:47 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1474407458 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Id: 7c63dc594a1a4977b67ccc1a63d09de4 Apr 11 18:13:47 user devstack@n-api.service[72345]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1474407458-project-member Apr 11 18:13:47 user devstack@n-api.service[72345]: method: > Apr 11 18:13:47 user devstack@n-api.service[72345]: exception: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: action_args: {'id': 'cd86b2f4-002e-48ab-987c-b081681b5e07'} Apr 11 18:13:47 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. Apr 11 18:13:47 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:13:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Returning 404 to user: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:13:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-bf811814-229f-4cd8-9cac-835ed8bcc579 tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07" status: 404 len: 111 microversion: 2.42 time: 0.032312 Apr 11 18:13:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:13:47 2023] GET /compute/v2.1/servers/cd86b2f4-002e-48ab-987c-b081681b5e07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:13:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1899339481", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "a526bfae-fdf9-449e-acc6-1cf2215b735f"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:49 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:49 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] validate_networks() for [('a526bfae-fdf9-449e-acc6-1cf2215b735f', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting quotas for project bf13b304615f48ab88c64755c2795c99. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting quotas for user 086769a77da24d95a54c35f917240664 and project bf13b304615f48ab88c64755c2795c99. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:13:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:13:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.326669 Apr 11 18:13:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 90/279] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:13:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:13:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-cafb47ad-3132-4604-aad0-e2a0aa76a1af tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-cafb47ad-3132-4604-aad0-e2a0aa76a1af tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:50 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-cafb47ad-3132-4604-aad0-e2a0aa76a1af tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-cafb47ad-3132-4604-aad0-e2a0aa76a1af tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e" status: 200 len: 1208 microversion: 2.1 time: 0.081779 Apr 11 18:13:50 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 97/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:50 2023] GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:53 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-23a5c7bc-5001-458b-8e5b-e631d8637eb6 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1670 microversion: 2.1 time: 0.250100 Apr 11 18:13:53 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:53 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=50 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Creating event network-changed:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:13:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034718 Apr 11 18:13:54 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 98/282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e2c149b8-19b8-47fd-9c9d-4cfb241eaae3 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Action: 'create', calling method: .version_select at 0x7fadb9704e50>, body: {"keypair": {"name": "tempest-keypair-581234075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2PgzNFmwBsFUNuQ95xhwKc3ab85OukYflSWY9oEAX8fbv+TSaubOQPFW2shpSVHS5iAGWk+Kf+qNt/RNc14rmRY/3EDWnt360T6Gp6M9r075izLzf0oeIHzGVgNGQ+SA=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:54 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-e2c149b8-19b8-47fd-9c9d-4cfb241eaae3 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:13:54 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-e2c149b8-19b8-47fd-9c9d-4cfb241eaae3 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for user d20726e00e3743168e32eafe43318e20 and project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:13:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e2c149b8-19b8-47fd-9c9d-4cfb241eaae3 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.353986 Apr 11 18:13:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 91/283] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:13:54 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d656453-9ad5-4870-b6af-cf2022addc76"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599671 Apr 11 18:13:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:13:55 2023] POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1603498422", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "bff39075-a0de-4117-8653-a12c13830d54"}], "security_groups": [{"name": "tempest-securitygroup--1395512588"}], "key_name": "tempest-keypair-581234075", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:13:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:13:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054266 Apr 11 18:13:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 92/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:13:57 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] validate_networks() for [('bff39075-a0de-4117-8653-a12c13830d54', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for user d20726e00e3743168e32eafe43318e20 and project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:13:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:13:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.684603 Apr 11 18:13:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 99/286] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:13:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:13:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ceeec495-e63a-4f68-9305-7573423a379a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:13:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ceeec495-e63a-4f68-9305-7573423a379a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:13:58 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-ceeec495-e63a-4f68-9305-7573423a379a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:13:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ceeec495-e63a-4f68-9305-7573423a379a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" status: 200 len: 1235 microversion: 2.1 time: 0.072911 Apr 11 18:13:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:13:58 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:13:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:13:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:13:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:13:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:13:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:13:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029176 Apr 11 18:13:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 93/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:01 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-913d19b7-1d24-4559-b9ef-d222bdc91bbf tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1656 microversion: 2.1 time: 0.276075 Apr 11 18:14:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 100/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:00 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1656 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e18a0321-da20-41e7-b97b-7350ae176fc5"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:01 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544957 Apr 11 18:14:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 97/290] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:14:01 2023] POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:03 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Creating event network-changed:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:14:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049383 Apr 11 18:14:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 94/291] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6b328821-9a04-4862-888e-2c185979a5cb tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Action: 'create', calling method: .version_select at 0x7fadb98a4e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2023281167"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6b328821-9a04-4862-888e-2c185979a5cb tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.697308 Apr 11 18:14:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 101/292] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 18:14:04 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 18:14:05 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c1bff12c-ca7d-4caa-9ac3-be8f98ecaff7 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9799750>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c1bff12c-ca7d-4caa-9ac3-be8f98ecaff7 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 200 len: 345 microversion: 2.1 time: 0.070626 Apr 11 18:14:05 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:05 2023] GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:05 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=10 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "name": "network-vif-plugged", "status": "completed", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Creating event network-vif-plugged:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:14:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046419 Apr 11 18:14:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 102/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-32f3328d-c18f-488c-b8e4-624cecdf26c4 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Action: 'create', calling method: .version_select at 0x7fadb9a6a9e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-694792435", "metadata": {"Type": "work"}}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-32f3328d-c18f-488c-b8e4-624cecdf26c4 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72343]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72343]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Length: 121 Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: Apr 11 18:14:06 user devstack@n-api.service[72343]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-694792435", "metadata": {"Type": "work"}}} Apr 11 18:14:06 user devstack@n-api.service[72343]: method: Apr 11 18:14:06 user devstack@n-api.service[72343]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72343]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-694792435', 'metadata': {'Type': 'work'}}}} Apr 11 18:14:06 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise error Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-32f3328d-c18f-488c-b8e4-624cecdf26c4 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-32f3328d-c18f-488c-b8e4-624cecdf26c4 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.334661 Apr 11 18:14:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 95/295] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 18:14:05 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-df67a29b-ed2c-42cc-bf8d-c6a73353cc1b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Action: 'create', calling method: .version_select at 0x7fadb979b760>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1662368851", "metadata": {"Type": "work"}}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-df67a29b-ed2c-42cc-bf8d-c6a73353cc1b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72345]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72345]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72345]: Content-Length: 120 Apr 11 18:14:06 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72345]: Apr 11 18:14:06 user devstack@n-api.service[72345]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1662368851", "metadata": {"Type": "work"}}} Apr 11 18:14:06 user devstack@n-api.service[72345]: method: Apr 11 18:14:06 user devstack@n-api.service[72345]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 18:14:06 user devstack@n-api.service[72345]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1662368851', 'metadata': {'Type': 'work'}}}} Apr 11 18:14:06 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise error Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi '0' Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-df67a29b-ed2c-42cc-bf8d-c6a73353cc1b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-df67a29b-ed2c-42cc-bf8d-c6a73353cc1b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011799 Apr 11 18:14:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 18:14:06 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f08a2a1d-519e-40c3-b0c7-e7a8ca39339d tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Action: 'create', calling method: .version_select at 0x7fadb98320e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1829710279", "metadata": {"Type": "work"}}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f08a2a1d-519e-40c3-b0c7-e7a8ca39339d tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72344]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72344]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72344]: Content-Length: 119 Apr 11 18:14:06 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72344]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72344]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72344]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72344]: Apr 11 18:14:06 user devstack@n-api.service[72344]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1829710279", "metadata": {"Type": "work"}}} Apr 11 18:14:06 user devstack@n-api.service[72344]: method: Apr 11 18:14:06 user devstack@n-api.service[72344]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72344]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1829710279', 'metadata': {'Type': 'work'}}}} Apr 11 18:14:06 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise error Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi '' Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 18:14:06 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f08a2a1d-519e-40c3-b0c7-e7a8ca39339d tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f08a2a1d-519e-40c3-b0c7-e7a8ca39339d tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022019 Apr 11 18:14:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 103/297] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 18:14:06 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ccb48604-4a16-4426-8a28-a9fa557417b5 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Calling method '.version_select at 0x7fadb9667be0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-ccb48604-4a16-4426-8a28-a9fa557417b5 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] HTTP exception thrown: Volume tempest-invalid-741313285 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ccb48604-4a16-4426-8a28-a9fa557417b5 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-741313285 HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72343]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: method: Apr 11 18:14:06 user devstack@n-api.service[72343]: exception: Volume tempest-invalid-741313285 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: action_args: {'id': 'tempest-invalid-741313285'} Apr 11 18:14:06 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-741313285 could not be found. (HTTP 404) (Request-ID: req-5164a5a5-213e-47b8-a20f-0c3751eb4037) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-741313285 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-741313285 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-741313285 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ccb48604-4a16-4426-8a28-a9fa557417b5 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 404 to user: Volume tempest-invalid-741313285 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ccb48604-4a16-4426-8a28-a9fa557417b5 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-741313285" status: 404 len: 98 microversion: 2.1 time: 0.048200 Apr 11 18:14:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 96/298] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 11 18:14:06 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-741313285 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-62007205-5de2-4e70-ad9b-e7e973884a82 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004327 Apr 11 18:14:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 18:14:06 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2d20a71c-d85b-49c8-8b5b-6f4ce61bc960 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003760 Apr 11 18:14:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 104/300] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 18:14:06 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c366e4e0-f14c-4a0b-af11-0ab8ef6ece7b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Calling method '.version_select at 0x7fadb9bf70a0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-c366e4e0-f14c-4a0b-af11-0ab8ef6ece7b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] HTTP exception thrown: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c366e4e0-f14c-4a0b-af11-0ab8ef6ece7b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/os-volumes/579716e1-108c-42d6-9e1c-dee59b100be2 HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72343]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:14:06 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72343]: method: Apr 11 18:14:06 user devstack@n-api.service[72343]: exception: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: action_args: {'id': '579716e1-108c-42d6-9e1c-dee59b100be2'} Apr 11 18:14:06 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. (HTTP 404) (Request-ID: req-7abdb71d-4093-412b-9f43-624ff0e5c83d) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c366e4e0-f14c-4a0b-af11-0ab8ef6ece7b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 404 to user: Volume 579716e1-108c-42d6-9e1c-dee59b100be2 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c366e4e0-f14c-4a0b-af11-0ab8ef6ece7b tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/579716e1-108c-42d6-9e1c-dee59b100be2" status: 404 len: 109 microversion: 2.1 time: 0.046772 Apr 11 18:14:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 97/301] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:14:06 2023] DELETE /compute/v2.1/os-volumes/579716e1-108c-42d6-9e1c-dee59b100be2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-cb1f56a7-190e-4da4-8a4e-3d99810e5fc1 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Calling method '.version_select at 0x7fadb979b910>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-cb1f56a7-190e-4da4-8a4e-3d99810e5fc1 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] HTTP exception thrown: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-cb1f56a7-190e-4da4-8a4e-3d99810e5fc1 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Request method failure captured: Apr 11 18:14:06 user devstack@n-api.service[72345]: request: GET /compute/v2.1/os-volumes/cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 HTTP/1.1 Apr 11 18:14:06 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:14:06 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:14:06 user devstack@n-api.service[72345]: Connection: close Apr 11 18:14:06 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:14:06 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:14:06 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:14:06 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:14:06 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNtbJUVyCoEJCUI6M692NzxA4PKH83McLtfZPaLr_pK0wctWQWKXSfoXLGkBJ-iMbfOCsgnaHxnnp94FMDRzsT7_rZln0Gew6J-B5RG5tFKsubqJBCL-5q2I5vBpn-fMflUkrVo2VVexarIMOKir1vZXq44rRbYjFtXLmYG1161S7I Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd2b63a3e5c24c37a77c40ac47f60912"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant-Id: fd2b63a3e5c24c37a77c40ac47f60912 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesNegativeTest-338699684 Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Id: fd0cf039c3224107a440c0e65ad072bb Apr 11 18:14:06 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesNegativeTest-338699684-project-member Apr 11 18:14:06 user devstack@n-api.service[72345]: method: Apr 11 18:14:06 user devstack@n-api.service[72345]: exception: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72345]: action_args: {'id': 'cbe7ce5e-86ef-4b67-9baa-c3cabbe01427'} Apr 11 18:14:06 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. (HTTP 404) (Request-ID: req-7203977a-494e-4066-9aa1-107704726b70) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. Apr 11 18:14:06 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-cb1f56a7-190e-4da4-8a4e-3d99810e5fc1 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] Returning 404 to user: Volume cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-cb1f56a7-190e-4da4-8a4e-3d99810e5fc1 tempest-VolumesNegativeTest-338699684 tempest-VolumesNegativeTest-338699684-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cbe7ce5e-86ef-4b67-9baa-c3cabbe01427" status: 404 len: 109 microversion: 2.1 time: 0.039509 Apr 11 18:14:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 101/302] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:06 2023] GET /compute/v2.1/os-volumes/cbe7ce5e-86ef-4b67-9baa-c3cabbe01427 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b9359951-7543-4c7a-bdcc-1cc3eb6dfeff tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb99b6e60>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b9359951-7543-4c7a-bdcc-1cc3eb6dfeff tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 200 len: 346 microversion: 2.1 time: 0.078683 Apr 11 18:14:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 105/303] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:06 2023] GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-30e85ace-eab5-41f0-a00e-ddd288ac4ec3 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Action: 'create', calling method: .version_select at 0x7fadb98b7640>, body: {"snapshot": {"volume_id": "4952c9bd-a697-479f-81fb-e49befdcf704", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1465841339"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-30e85ace-eab5-41f0-a00e-ddd288ac4ec3 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.185167 Apr 11 18:14:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 98/304] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 18:14:06 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-20eae145-aa70-4762-bc36-b8f4b9a42e91 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9727640>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-20eae145-aa70-4762-bc36-b8f4b9a42e91 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 200 len: 287 microversion: 2.1 time: 0.039856 Apr 11 18:14:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 18:14:06 2023] GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2b0dc4ed-d9af-4076-9e6d-b3148fce43c0 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9831900>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:07 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2b0dc4ed-d9af-4076-9e6d-b3148fce43c0 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083307 Apr 11 18:14:07 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 106/306] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 18:14:06 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:07 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e5451a12-06c4-4040-a781-5184d1f7155e tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9666320>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e5451a12-06c4-4040-a781-5184d1f7155e tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 200 len: 287 microversion: 2.1 time: 0.064105 Apr 11 18:14:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 99/307] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 18:14:07 2023] GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "name": "network-vif-plugged", "status": "completed", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Creating event network-vif-plugged:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:14:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Apr 11 18:14:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-91c85dbe-b819-4045-ada7-b177fec3a099 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb98a6a70>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-91c85dbe-b819-4045-ada7-b177fec3a099 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 200 len: 288 microversion: 2.1 time: 0.049475 Apr 11 18:14:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 107/309] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 18:14:08 2023] GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-231f0288-4aa5-457d-944b-62b949c17b25 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9665750>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "06e3ca91-1344-4d75-bb85-d0666535be8c"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:08 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'flavor' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:14:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-231f0288-4aa5-457d-944b-62b949c17b25 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 202 len: 0 microversion: 2.1 time: 0.097107 Apr 11 18:14:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 100/310] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 18:14:08 2023] DELETE /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-08969537-5fef-4176-8870-2360ecc43b06 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9833ac0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-08969537-5fef-4176-8870-2360ecc43b06 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 200 len: 287 microversion: 2.1 time: 0.054899 Apr 11 18:14:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 108/311] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 18:14:08 2023] GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action" status: 200 len: 29 microversion: 2.1 time: 0.249758 Apr 11 18:14:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 104/312] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:14:08 2023] POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action => generated 29 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:08 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a293dfe7-6b6d-4e38-8b37-5514e4fdabad tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1722 microversion: 2.1 time: 0.356957 Apr 11 18:14:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 101/313] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:08 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ac196a92-c6d5-4035-96e1-c4eeb03f2619 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb98305e0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-ac196a92-c6d5-4035-96e1-c4eeb03f2619 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] HTTP exception thrown: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ac196a92-c6d5-4035-96e1-c4eeb03f2619 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Request method failure captured: Apr 11 18:14:09 user devstack@n-api.service[72344]: request: GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 HTTP/1.1 Apr 11 18:14:09 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:14:09 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:14:09 user devstack@n-api.service[72344]: Connection: close Apr 11 18:14:09 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:14:09 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:14:09 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:14:09 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:14:09 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaNspj0HFLt8CDyrQokSJaNflSioh_ji6_Ia7_1u8pUkNcAPlX2wBvajBrXtTBsSFziaAviscdb5rdygP_XuUoBwFerV5ksaJWZi9ldYo9cMCSRyNNL7vCdHN6UHiwACZKSVAL6bdCKgXLEgyrJTjrTmTFbTxUfILhMxMt67lRnzC5w Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Project-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Tenant-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-User: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:09 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:14:09 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:14:09 user devstack@n-api.service[72344]: X-User-Id: 8c9adc7cb80340cd869ec7b3f8e01c61 Apr 11 18:14:09 user devstack@n-api.service[72344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:09 user devstack@n-api.service[72344]: method: Apr 11 18:14:09 user devstack@n-api.service[72344]: exception: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. Apr 11 18:14:09 user devstack@n-api.service[72344]: action_args: {'id': '95931a93-119c-40b4-ba82-84e4228cc199'} Apr 11 18:14:09 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. (HTTP 404) (Request-ID: req-8cdf28a9-98c5-4334-9611-40d07b8a9521) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. Apr 11 18:14:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ac196a92-c6d5-4035-96e1-c4eeb03f2619 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Returning 404 to user: Snapshot 95931a93-119c-40b4-ba82-84e4228cc199 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ac196a92-c6d5-4035-96e1-c4eeb03f2619 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199" status: 404 len: 111 microversion: 2.1 time: 0.041748 Apr 11 18:14:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 109/314] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 18:14:09 2023] GET /compute/v2.1/os-snapshots/95931a93-119c-40b4-ba82-84e4228cc199 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-fee7f8b2-530f-4812-b366-16e46a7124c8 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9727f40>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-fee7f8b2-530f-4812-b366-16e46a7124c8 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 202 len: 0 microversion: 2.1 time: 0.107430 Apr 11 18:14:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 105/315] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:14:09 2023] DELETE /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8d621b91-4d67-485e-a0a0-0023ae5a76ba tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9664430>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Creating event network-vif-unplugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:14:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044591 Apr 11 18:14:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 110/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8d621b91-4d67-485e-a0a0-0023ae5a76ba tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 200 len: 345 microversion: 2.1 time: 0.105103 Apr 11 18:14:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 102/317] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:09 2023] GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:09 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-82b17c08-794f-49f9-933c-7e46eed80c0e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1702 microversion: 2.1 time: 0.226267 Apr 11 18:14:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 106/318] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:09 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1702 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-731201773", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: dict_keys(['metadata_items']) {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: dict_keys(['metadata_items']) {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action" status: 202 len: 1159 microversion: 2.1 time: 0.526952 Apr 11 18:14:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 111/319] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 18:14:09 2023] POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action => generated 1159 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-71ca0861-dd7d-4c1e-9fd3-7689b9f6062c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1729 microversion: 2.1 time: 0.203627 Apr 11 18:14:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 103/320] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:10 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-189d5ed0-8b75-4f42-a35c-3e72910a8e92 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9799480>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-189d5ed0-8b75-4f42-a35c-3e72910a8e92 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] HTTP exception thrown: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-189d5ed0-8b75-4f42-a35c-3e72910a8e92 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Request method failure captured: Apr 11 18:14:10 user devstack@n-api.service[72345]: request: GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 HTTP/1.1 Apr 11 18:14:10 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:14:10 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:14:10 user devstack@n-api.service[72345]: Connection: close Apr 11 18:14:10 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:14:10 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:14:10 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:14:10 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:14:10 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNspj0HFLt8CDyrQokSJaNflSioh_ji6_Ia7_1u8pUkNcAPlX2wBvajBrXtTBsSFziaAviscdb5rdygP_XuUoBwFerV5ksaJWZi9ldYo9cMCSRyNNL7vCdHN6UHiwACZKSVAL6bdCKgXLEgyrJTjrTmTFbTxUfILhMxMt67lRnzC5w Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Project-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Tenant-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-User: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72345]: X-User-Id: 8c9adc7cb80340cd869ec7b3f8e01c61 Apr 11 18:14:10 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72345]: method: Apr 11 18:14:10 user devstack@n-api.service[72345]: exception: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72345]: action_args: {'id': '4952c9bd-a697-479f-81fb-e49befdcf704'} Apr 11 18:14:10 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. (HTTP 404) (Request-ID: req-e87f644b-ab82-4441-a81e-9e5c0549b1d9) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-189d5ed0-8b75-4f42-a35c-3e72910a8e92 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Returning 404 to user: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-189d5ed0-8b75-4f42-a35c-3e72910a8e92 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 404 len: 109 microversion: 2.1 time: 0.048866 Apr 11 18:14:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 107/321] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:10 2023] GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3bdf47d-efc1-479d-8173-e2c5f02d40dc tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb99b6c20>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-c3bdf47d-efc1-479d-8173-e2c5f02d40dc tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] HTTP exception thrown: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3bdf47d-efc1-479d-8173-e2c5f02d40dc tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Request method failure captured: Apr 11 18:14:10 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 HTTP/1.1 Apr 11 18:14:10 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:14:10 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:14:10 user devstack@n-api.service[72344]: Connection: close Apr 11 18:14:10 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:14:10 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:14:10 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:14:10 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:14:10 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaNspj0HFLt8CDyrQokSJaNflSioh_ji6_Ia7_1u8pUkNcAPlX2wBvajBrXtTBsSFziaAviscdb5rdygP_XuUoBwFerV5ksaJWZi9ldYo9cMCSRyNNL7vCdHN6UHiwACZKSVAL6bdCKgXLEgyrJTjrTmTFbTxUfILhMxMt67lRnzC5w Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Project-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Tenant-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-User: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72344]: X-User-Id: 8c9adc7cb80340cd869ec7b3f8e01c61 Apr 11 18:14:10 user devstack@n-api.service[72344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72344]: method: Apr 11 18:14:10 user devstack@n-api.service[72344]: exception: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72344]: action_args: {'id': '4952c9bd-a697-479f-81fb-e49befdcf704'} Apr 11 18:14:10 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. (HTTP 404) (Request-ID: req-490d4d9b-2b8d-4335-bb3a-6446f195dc79) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3bdf47d-efc1-479d-8173-e2c5f02d40dc tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Returning 404 to user: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c3bdf47d-efc1-479d-8173-e2c5f02d40dc tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 404 len: 109 microversion: 2.1 time: 0.052532 Apr 11 18:14:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 112/322] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:14:10 2023] DELETE /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-522cb0b0-1bc2-46f9-b0a9-269c4b20f308 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Calling method '.version_select at 0x7fadb9667370>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-522cb0b0-1bc2-46f9-b0a9-269c4b20f308 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] HTTP exception thrown: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-522cb0b0-1bc2-46f9-b0a9-269c4b20f308 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Request method failure captured: Apr 11 18:14:10 user devstack@n-api.service[72343]: request: GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 HTTP/1.1 Apr 11 18:14:10 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:14:10 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:14:10 user devstack@n-api.service[72343]: Connection: close Apr 11 18:14:10 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:14:10 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:14:10 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:14:10 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:14:10 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaNspj0HFLt8CDyrQokSJaNflSioh_ji6_Ia7_1u8pUkNcAPlX2wBvajBrXtTBsSFziaAviscdb5rdygP_XuUoBwFerV5ksaJWZi9ldYo9cMCSRyNNL7vCdHN6UHiwACZKSVAL6bdCKgXLEgyrJTjrTmTFbTxUfILhMxMt67lRnzC5w Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Project-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/415bee6c0c6145d2862b4befca54ac00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Tenant-Id: 415bee6c0c6145d2862b4befca54ac00 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1261746772 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-User: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:14:10 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:14:10 user devstack@n-api.service[72343]: X-User-Id: 8c9adc7cb80340cd869ec7b3f8e01c61 Apr 11 18:14:10 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1261746772-project-member Apr 11 18:14:10 user devstack@n-api.service[72343]: method: Apr 11 18:14:10 user devstack@n-api.service[72343]: exception: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72343]: action_args: {'id': '4952c9bd-a697-479f-81fb-e49befdcf704'} Apr 11 18:14:10 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. (HTTP 404) (Request-ID: req-6e2383d7-86f4-486f-8589-75ee1b986bde) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. Apr 11 18:14:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-522cb0b0-1bc2-46f9-b0a9-269c4b20f308 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] Returning 404 to user: Volume 4952c9bd-a697-479f-81fb-e49befdcf704 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-522cb0b0-1bc2-46f9-b0a9-269c4b20f308 tempest-VolumesSnapshotsTestJSON-1261746772 tempest-VolumesSnapshotsTestJSON-1261746772-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704" status: 404 len: 109 microversion: 2.1 time: 0.053840 Apr 11 18:14:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 104/323] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:10 2023] GET /compute/v2.1/os-volumes/4952c9bd-a697-479f-81fb-e49befdcf704 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:14:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Apr 11 18:14:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 108/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-unplugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Creating event network-vif-unplugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:14:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033134 Apr 11 18:14:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 113/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:14:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044121 Apr 11 18:14:14 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9f87e738-ee20-44c7-bd00-fbb1c0c1beae tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1435 microversion: 2.1 time: 1.182943 Apr 11 18:14:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 105/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:13 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1435 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:14:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Apr 11 18:14:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 114/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:16 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9db27b1d-f157-4bec-a2fb-5b3db95d0333 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9798430>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9db27b1d-f157-4bec-a2fb-5b3db95d0333 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/74f601b5-caef-4939-a821-4863391b741a" status: 200 len: 350 microversion: 2.1 time: 0.050123 Apr 11 18:14:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:16 2023] GET /compute/v2.1/os-volumes/74f601b5-caef-4939-a821-4863391b741a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:17 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:14:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036437 Apr 11 18:14:17 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 106/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8ccfb402-adfd-4e1d-86f2-89c7c075daac tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb99b64d0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:17 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8ccfb402-adfd-4e1d-86f2-89c7c075daac tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9b39d367-a3d1-4815-8e9d-bc0581ab6f71" status: 200 len: 351 microversion: 2.1 time: 0.086549 Apr 11 18:14:17 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 115/331] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:17 2023] GET /compute/v2.1/os-volumes/9b39d367-a3d1-4815-8e9d-bc0581ab6f71 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b61848a9-43be-421b-a4e2-f045cc715991 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb97fb2e0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b61848a9-43be-421b-a4e2-f045cc715991 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dee5a92b-fade-4fea-a4fa-08b018011636" status: 200 len: 351 microversion: 2.1 time: 0.061580 Apr 11 18:14:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes/dee5a92b-fade-4fea-a4fa-08b018011636 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-534852c6-93f6-4e00-ad09-1eeee8742925 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9666440>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-534852c6-93f6-4e00-ad09-1eeee8742925 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.097120 Apr 11 18:14:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 107/333] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-461c0543-b302-4267-8810-065c402b2e8f tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9791750>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-461c0543-b302-4267-8810-065c402b2e8f tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102021 Apr 11 18:14:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 116/334] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9d5decb4-522d-4919-82ea-81e743c204db tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9799d80>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9d5decb4-522d-4919-82ea-81e743c204db tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.342603 Apr 11 18:14:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4d9b9746-e05e-4859-9bce-e538c36fc42a tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9b44940>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4d9b9746-e05e-4859-9bce-e538c36fc42a tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091179 Apr 11 18:14:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 117/336] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9ef4147f-888d-4090-9abd-e5d5b5fea2c0 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb97fab00>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:19 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ac49d750-ffbc-4acd-b9d0-dc7945a46552 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1748 microversion: 2.1 time: 0.190944 Apr 11 18:14:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 108/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1748 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9ef4147f-888d-4090-9abd-e5d5b5fea2c0 tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086950 Apr 11 18:14:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d305ec02-a999-47d6-a33f-7ca5062e916d tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9792b90>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d305ec02-a999-47d6-a33f-7ca5062e916d tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.103252 Apr 11 18:14:20 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 118/339] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 18:14:19 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2cc4c7e4-3d35-46f9-9d01-7c3a98f5f67d tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb9665bd0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2cc4c7e4-3d35-46f9-9d01-7c3a98f5f67d tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085291 Apr 11 18:14:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 109/340] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 18:14:20 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b85b0fac-a3fd-4aac-9ea8-fd6402f07a5b tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] Calling method '.version_select at 0x7fadb979b370>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:20 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b85b0fac-a3fd-4aac-9ea8-fd6402f07a5b tempest-VolumesTestJSON-286886768 tempest-VolumesTestJSON-286886768-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097865 Apr 11 18:14:20 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 18:14:20 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:14:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Apr 11 18:14:24 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 119/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:14:26 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:14:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Apr 11 18:14:26 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 110/343] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=9 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:28 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] HTTP exception thrown: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Request method failure captured: Apr 11 18:14:28 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b HTTP/1.1 Apr 11 18:14:28 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:14:28 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:14:28 user devstack@n-api.service[72345]: Connection: close Apr 11 18:14:28 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:14:28 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:14:28 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:14:28 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:14:28 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJ4Gq5kRA16G5IX019sbF8TPqtfq43ODiUUQFVjLqgVoi1L4LfoSWX0o6upaZqcckvvx7XcUpHMIZInz9LidcJf3x1qxm0PQXKujp_3hbhJnQo3nkSIebZePyTBt4U-Ur9wudJxN-PJw7wqm_Yl2rL6LUhZppD0k-HfBBVZhi6hsZQ Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Project-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Project-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9376efafce66467aa4efde41acbce713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Tenant: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Tenant-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-User: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:28 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:14:28 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:14:28 user devstack@n-api.service[72345]: X-User-Id: d70760a1251b4629afcc8c80ae00c659 Apr 11 18:14:28 user devstack@n-api.service[72345]: X-User-Name: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:28 user devstack@n-api.service[72345]: method: > Apr 11 18:14:28 user devstack@n-api.service[72345]: exception: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:28 user devstack@n-api.service[72345]: action_args: {'id': '9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b'} Apr 11 18:14:28 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:28 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:28 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Returning 404 to user: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:28 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-649274dd-5ec8-4f4b-ac0d-e74dcf33a2e9 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 404 len: 111 microversion: 2.49 time: 0.045405 Apr 11 18:14:28 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 115/344] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:14:28 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f8c2b58c-e578-4218-a611-973200fc7d6a tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '.version_select at 0x7fadb97925f0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:28 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f8c2b58c-e578-4218-a611-973200fc7d6a tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120431301" status: 204 len: 0 microversion: 2.49 time: 0.031721 Apr 11 18:14:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 120/345] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 18:14:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120431301 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=34 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] HTTP exception thrown: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Request method failure captured: Apr 11 18:14:30 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b HTTP/1.1 Apr 11 18:14:30 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:14:30 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:14:30 user devstack@n-api.service[72343]: Connection: close Apr 11 18:14:30 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:14:30 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:14:30 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:14:30 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:14:30 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ4Gq5kRA16G5IX019sbF8TPqtfq43ODiUUQFVjLqgVoi1L4LfoSWX0o6upaZqcckvvx7XcUpHMIZInz9LidcJf3x1qxm0PQXKujp_3hbhJnQo3nkSIebZePyTBt4U-Ur9wudJxN-PJw7wqm_Yl2rL6LUhZppD0k-HfBBVZhi6hsZQ Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Project-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Project-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9376efafce66467aa4efde41acbce713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Tenant: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Tenant-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-User: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:30 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:14:30 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:14:30 user devstack@n-api.service[72343]: X-User-Id: d70760a1251b4629afcc8c80ae00c659 Apr 11 18:14:30 user devstack@n-api.service[72343]: X-User-Name: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:30 user devstack@n-api.service[72343]: method: > Apr 11 18:14:30 user devstack@n-api.service[72343]: exception: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72343]: action_args: {'id': '9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b'} Apr 11 18:14:30 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Returning 404 to user: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7ea7a98e-417c-45ef-88fe-71e02a537213 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 404 len: 111 microversion: 2.49 time: 0.039493 Apr 11 18:14:30 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 111/346] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:14:30 2023] DELETE /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] HTTP exception thrown: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Request method failure captured: Apr 11 18:14:30 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b HTTP/1.1 Apr 11 18:14:30 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:14:30 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:14:30 user devstack@n-api.service[72345]: Connection: close Apr 11 18:14:30 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:14:30 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:14:30 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:14:30 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:14:30 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJ4Gq5kRA16G5IX019sbF8TPqtfq43ODiUUQFVjLqgVoi1L4LfoSWX0o6upaZqcckvvx7XcUpHMIZInz9LidcJf3x1qxm0PQXKujp_3hbhJnQo3nkSIebZePyTBt4U-Ur9wudJxN-PJw7wqm_Yl2rL6LUhZppD0k-HfBBVZhi6hsZQ Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Project-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Project-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9376efafce66467aa4efde41acbce713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9376efafce66467aa4efde41acbce713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Tenant: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Tenant-Id: 9376efafce66467aa4efde41acbce713 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TaggedAttachmentsTest-915024626 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-User: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:30 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:14:30 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:14:30 user devstack@n-api.service[72345]: X-User-Id: d70760a1251b4629afcc8c80ae00c659 Apr 11 18:14:30 user devstack@n-api.service[72345]: X-User-Name: tempest-TaggedAttachmentsTest-915024626-project-member Apr 11 18:14:30 user devstack@n-api.service[72345]: method: > Apr 11 18:14:30 user devstack@n-api.service[72345]: exception: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72345]: action_args: {'id': '9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b'} Apr 11 18:14:30 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. Apr 11 18:14:30 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:14:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Returning 404 to user: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-46acf376-a334-44bf-a0ee-ca8389d38e9e tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" status: 404 len: 111 microversion: 2.49 time: 0.035641 Apr 11 18:14:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 116/347] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:14:30 2023] GET /compute/v2.1/servers/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] HTTP exception thrown: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Request method failure captured: Apr 11 18:14:31 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 HTTP/1.1 Apr 11 18:14:31 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:14:31 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:14:31 user devstack@n-api.service[72344]: Connection: close Apr 11 18:14:31 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:14:31 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:14:31 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:14:31 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:14:31 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ236sDunqR_CLuFqWKJAkxzxFzxNBoIVW47YDMIpoZb_Gvc0aPXoQJQVhN2E47y6LxFbm8PoqKecCkmUDCMNIgPWwwpM2CzI8ZV4EpJpMdEZJ4vIqo1TlWrfFkVSqDsWBEvosMxwmde9YNyVFgpuIJRcDPV_qq-O6tlTWmH1vDtXs Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Project-Id: 19acb9280d2f48b59ad7b2fde0e4efb3 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestVolumeSwap-1807194571 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19acb9280d2f48b59ad7b2fde0e4efb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19acb9280d2f48b59ad7b2fde0e4efb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19acb9280d2f48b59ad7b2fde0e4efb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Tenant: tempest-TestVolumeSwap-1807194571 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Tenant-Id: 19acb9280d2f48b59ad7b2fde0e4efb3 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestVolumeSwap-1807194571 Apr 11 18:14:31 user devstack@n-api.service[72344]: X-User: tempest-TestVolumeSwap-1807194571-project-member Apr 11 18:14:31 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:14:31 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:14:31 user devstack@n-api.service[72344]: X-User-Id: a6d4a1de4c8e49a0a14eec670db8ff0f Apr 11 18:14:31 user devstack@n-api.service[72344]: X-User-Name: tempest-TestVolumeSwap-1807194571-project-member Apr 11 18:14:31 user devstack@n-api.service[72344]: method: > Apr 11 18:14:31 user devstack@n-api.service[72344]: exception: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. Apr 11 18:14:31 user devstack@n-api.service[72344]: action_args: {'id': 'c107e5ac-af58-4702-aa62-253f3424c585'} Apr 11 18:14:31 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. Apr 11 18:14:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:14:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Returning 404 to user: Instance c107e5ac-af58-4702-aa62-253f3424c585 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:14:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-81614c46-86e1-48b8-a535-74f9371d0f1b tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585" status: 404 len: 111 microversion: 2.1 time: 0.034209 Apr 11 18:14:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 121/348] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:31 2023] GET /compute/v2.1/servers/c107e5ac-af58-4702-aa62-253f3424c585 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:14:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-96bf04e6-522f-4d63-96f5-22086eaf00db tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Calling method '.version_select at 0x7fadb9666440>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-96bf04e6-522f-4d63-96f5-22086eaf00db tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379978453" status: 202 len: 0 microversion: 2.1 time: 0.025770 Apr 11 18:14:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 112/349] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:14:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379978453 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-951270215", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] validate_networks() for None {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Getting quotas for project d6a391811fbc45a4a36f4fa1a63cee7f. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Getting quotas for user 0c4a8dda134b46e4bd1ebf41c01cf218 and project d6a391811fbc45a4a36f4fa1a63cee7f. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:14:39 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:14:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.645843 Apr 11 18:14:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 117/350] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:14:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:14:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b801b6be-dc07-43a5-a3fd-0e901fcf48ad tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:39 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b801b6be-dc07-43a5-a3fd-0e901fcf48ad tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:40 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-b801b6be-dc07-43a5-a3fd-0e901fcf48ad tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a8dda134b46e4bd1ebf41c01cf218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a391811fbc45a4a36f4fa1a63cee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:40 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b801b6be-dc07-43a5-a3fd-0e901fcf48ad tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe" status: 200 len: 1208 microversion: 2.1 time: 0.211437 Apr 11 18:14:40 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 122/351] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:39 2023] GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe => generated 1208 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:41 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b446c4c5-d399-4d42-8bb9-c22ba0bfe920 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e" status: 200 len: 1487 microversion: 2.1 time: 0.267237 Apr 11 18:14:41 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 113/352] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:41 2023] GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e => generated 1487 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:43 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Creating event network-changed:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:14:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027991 Apr 11 18:14:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 118/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:45 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:14:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046901 Apr 11 18:14:45 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 123/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:46 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:14:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/action" status: 200 len: 32 microversion: 2.1 time: 0.170274 Apr 11 18:14:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 114/355] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:14:46 2023] POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:46 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:46 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-3e1d8bf2-1e4f-4ed3-9282-994cb22b73fd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1510 microversion: 2.1 time: 0.214295 Apr 11 18:14:46 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:46 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Creating event network-vif-unplugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:14:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040209 Apr 11 18:14:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 124/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:14:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047943 Apr 11 18:14:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 115/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:48 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-69cd0f52-fb0d-40cc-b8d7-3ab096dcdfb0 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" status: 200 len: 1546 microversion: 2.1 time: 0.281598 Apr 11 18:14:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 120/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:48 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:14:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Apr 11 18:14:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 125/360] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:51 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:14:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:14:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036712 Apr 11 18:14:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 116/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:52 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:52 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-cce79557-1425-4f58-95bc-40ef434f10e1 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: .version_select at 0x7fadb979a440>, body: {"keypair": {"name": "tempest-keypair-353094075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:53 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-cce79557-1425-4f58-95bc-40ef434f10e1 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for project d77a56502d9848a3842c938d5adc8c51. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:14:53 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-cce79557-1425-4f58-95bc-40ef434f10e1 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for user b852c50aeb514b7fbe5a9b72e8bbdc14 and project d77a56502d9848a3842c938d5adc8c51. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:14:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-cce79557-1425-4f58-95bc-40ef434f10e1 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.354990 Apr 11 18:14:53 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 121/362] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:14:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-977045182", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b10563fa-e007-4ce1-9088-f81d415728c4"}], "security_groups": [{"name": "tempest-securitygroup--1379630374"}], "key_name": "tempest-keypair-353094075", "user_data": "}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:54 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] validate_networks() for [('b10563fa-e007-4ce1-9088-f81d415728c4', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for project d77a56502d9848a3842c938d5adc8c51. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for user b852c50aeb514b7fbe5a9b72e8bbdc14 and project d77a56502d9848a3842c938d5adc8c51. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:14:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:14:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.866526 Apr 11 18:14:55 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 126/363] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:14:54 2023] POST /compute/v2.1/servers => generated 400 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:14:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-09089d8f-b582-4408-ad1e-02874797e497 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:55 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-09089d8f-b582-4408-ad1e-02874797e497 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:55 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-09089d8f-b582-4408-ad1e-02874797e497 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-09089d8f-b582-4408-ad1e-02874797e497 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1230 microversion: 2.1 time: 0.069826 Apr 11 18:14:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 117/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:55 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:14:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=20 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:59 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Creating event network-changed:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:14:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042459 Apr 11 18:14:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 127/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:14:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9f510214-6985-44f1-819b-681d8df2dee0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: .version_select at 0x7fadb9665480>, body: {"keypair": {"name": "tempest-keypair-504297625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9a9nPmAjerdldl6YPoScXwpgamwr3rJP1TIHx991AR4t6+N4RmymMGiHE3v2lIBtDFvIO76lEEbpVn4KSmVi5IAdIIF3VrPq8fW57dXsGj5RDaIQss3YEolDQ5cNSocQ=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:14:59 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-9f510214-6985-44f1-819b-681d8df2dee0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:14:59 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-9f510214-6985-44f1-819b-681d8df2dee0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for user b724859b7dcd4fd29f17bbf991e9f6d4 and project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:14:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9f510214-6985-44f1-819b-681d8df2dee0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.107504 Apr 11 18:14:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 118/366] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 18:14:59 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:14:59 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:14:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-adc7b538-400b-4bce-94cd-f066fb25ef62 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1702 microversion: 2.1 time: 0.523211 Apr 11 18:14:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:14:58 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1702 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:01 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-23ec4d08-ed8e-4e8f-8d36-437d89cea7a3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.304852 Apr 11 18:15:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 128/368] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:00 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:01 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1005799066", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a"}], "security_groups": [{"name": "tempest-securitygroup--2006659942"}], "key_name": "tempest-keypair-504297625", "user_data": "}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:01 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] validate_networks() for [('bde85ee5-a5c4-4773-b4dd-b58d44a7f92a', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:15:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:15:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052919 Apr 11 18:15:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 123/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for user b724859b7dcd4fd29f17bbf991e9f6d4 and project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:15:02 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:15:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.977806 Apr 11 18:15:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 119/370] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:15:01 2023] POST /compute/v2.1/servers => generated 400 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:15:02 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:02 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:02 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:02 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:02 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:02 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b9503c90-90c6-49c2-b510-6e368063bd5f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1275 microversion: 2.20 time: 0.070780 Apr 11 18:15:02 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 129/371] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:15:02 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1275 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:15:04 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:15:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045441 Apr 11 18:15:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 124/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Creating event network-changed:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:15:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034306 Apr 11 18:15:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 120/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:15:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042422 Apr 11 18:15:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 130/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-750b73d4-ad70-4305-8d43-da80fa61dc20 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'create', calling method: .version_select at 0x7fadb97fb640>, body: {"keypair": {"name": "tempest-TestStampPattern-1363613236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:10 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-750b73d4-ad70-4305-8d43-da80fa61dc20 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for project 86e02898b1bc4378822244d9522ff042. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:15:10 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-750b73d4-ad70-4305-8d43-da80fa61dc20 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for user c44e6b75d86f4ff0b6f93123ce15ccc0 and project 86e02898b1bc4378822244d9522ff042. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:15:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-750b73d4-ad70-4305-8d43-da80fa61dc20 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.202075 Apr 11 18:15:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 125/375] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:15:10 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:15:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041750 Apr 11 18:15:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 121/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:12 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1875082957", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1363613236", "security_groups": [{"name": "tempest-secgroup-smoke-417180555"}], "networks": [{"uuid": "6c15015e-33ba-4615-94fd-f8253338eb8a"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] validate_networks() for [('6c15015e-33ba-4615-94fd-f8253338eb8a', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=20 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for project 86e02898b1bc4378822244d9522ff042. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for user c44e6b75d86f4ff0b6f93123ce15ccc0 and project 86e02898b1bc4378822244d9522ff042. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:15:13 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:15:13 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.670954 Apr 11 18:15:13 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 131/377] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:15:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:15:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1e8c3e27-7630-4e77-ba14-bec8ffae35d5 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:13 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1e8c3e27-7630-4e77-ba14-bec8ffae35d5 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:13 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1e8c3e27-7630-4e77-ba14-bec8ffae35d5 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1e8c3e27-7630-4e77-ba14-bec8ffae35d5 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 200 len: 1237 microversion: 2.1 time: 0.139671 Apr 11 18:15:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 126/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:13 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-1ff16559-230b-415b-985b-d2f6f371afa6 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1435 microversion: 2.1 time: 0.279809 Apr 11 18:15:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 122/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:15 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1435 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Creating event network-changed:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:15:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153396 Apr 11 18:15:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 132/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:17 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=10 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Creating event network-changed:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095261 Apr 11 18:15:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:17 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'flavor' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:15:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c/action" status: 202 len: 0 microversion: 2.1 time: 0.138180 Apr 11 18:15:17 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 123/382] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:15:17 2023] POST /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:18 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-52b821a3-08ef-49d6-add0-a01f5177095c tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1441 microversion: 2.1 time: 0.321586 Apr 11 18:15:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 133/383] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:17 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1441 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:18 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Creating event network-vif-unplugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047393 Apr 11 18:15:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 128/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:18 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1032118760"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:20 user devstack@n-api.service[72343]: INFO nova.network.security_group_api [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Removing security group 4324e722-d73f-4702-bd09-ee47f830ed64 from port 9f1432e1-1448-4815-a940-c004344002a0 Apr 11 18:15:20 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:20 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Creating event network-changed:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116308 Apr 11 18:15:20 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 134/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}, {"server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-unplugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-plugged:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Creating event network-vif-plugged:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:15:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.066509 Apr 11 18:15:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8cb2cb27-ec94-4418-9d7f-43651cd071f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action" status: 202 len: 0 microversion: 2.1 time: 0.742157 Apr 11 18:15:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 124/387] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:15:20 2023] POST /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:15:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Creating event network-changed:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Apr 11 18:15:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 135/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:22 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'services' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:15:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments/66e98e6d-f7ea-48df-a28b-c9148c90317e" status: 202 len: 0 microversion: 2.1 time: 0.298741 Apr 11 18:15:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:15:21 2023] DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments/66e98e6d-f7ea-48df-a28b-c9148c90317e => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:22 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-dcf09b01-2125-4b67-a3cc-963e7d44a2f1 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103032 Apr 11 18:15:22 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 125/390] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:15:22 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Creating event network-changed:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:15:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061672 Apr 11 18:15:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 136/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:30 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a8dda134b46e4bd1ebf41c01cf218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a391811fbc45a4a36f4fa1a63cee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-93e35617-52c7-4b38-ba8b-3e074baeffd1 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe" status: 200 len: 1454 microversion: 2.1 time: 0.650532 Apr 11 18:15:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:30 2023] GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe => generated 1454 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:37 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7b21f60a-1fc3-4c89-9a54-5b3935f5aebc tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1490 microversion: 2.1 time: 0.241904 Apr 11 18:15:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 126/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:37 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1490 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=15 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:15:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e" status: 204 len: 0 microversion: 2.1 time: 0.123707 Apr 11 18:15:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 137/394] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:15:41 2023] DELETE /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:42 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-07685846-ca41-47fe-9792-c1a4d96b6582 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e" status: 200 len: 1493 microversion: 2.1 time: 0.174736 Apr 11 18:15:42 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 132/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:41 2023] GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e => generated 1493 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-unplugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Creating event network-vif-unplugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030549 Apr 11 18:15:42 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 127/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:43 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-deleted", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:43 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:43 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:43 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:43 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] Creating event network-vif-deleted:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:43 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Apr 11 18:15:43 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 138/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:44 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}, {"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}, {"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}, {"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-unplugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}, {"server_uuid": "34ce2adc-e171-42fd-8c28-6359d56f612e", "name": "network-vif-plugged", "status": "completed", "tag": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Creating event network-vif-unplugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Creating event network-vif-plugged:e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance 34ce2adc-e171-42fd-8c28-6359d56f612e on user Apr 11 18:15:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034191 Apr 11 18:15:44 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 133/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:45 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-acbdf9f7-2ee1-4318-82be-66fce399dd92 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1535 microversion: 2.1 time: 0.151392 Apr 11 18:15:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 128/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:15:45 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1535 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2e143d35-4dff-40b3-9a28-965ce254a944 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.086607 Apr 11 18:15:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 139/400] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:15:48 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-interface => generated 283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Creating event network-changed:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:15:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Apr 11 18:15:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7df58904-80cf-4563-a8a4-8e753e6eed96"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351181 Apr 11 18:15:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 129/402] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:15:51 2023] POST /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:52 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:15:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8285454e-ba73-44d3-8a9a-8de853340a0b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1587 microversion: 2.20 time: 0.164325 Apr 11 18:15:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 140/403] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:15:52 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1587 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "57be660e-2a28-40ac-8582-96901e9582e0"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] HTTP exception thrown: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. Apr 11 18:15:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Request method failure captured: Apr 11 18:15:58 user devstack@n-api.service[72345]: request: PUT /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments/7df58904-80cf-4563-a8a4-8e753e6eed96 HTTP/1.1 Apr 11 18:15:58 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:15:58 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:15:58 user devstack@n-api.service[72345]: Connection: close Apr 11 18:15:58 user devstack@n-api.service[72345]: Content-Length: 74 Apr 11 18:15:58 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:15:58 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:15:58 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:15:58 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNiIDrNVl3hzaI7S4Hnw915dbCUCwfMkt79PQOyokEbwlYZCrMkpcnRiBWZdrajKkbvUKeCAQGK3QeSskZtW00FwQcAqi4wCkedAkOpx82AuPPFA_bHJ5bPV0uJK-BxiP50nfw0ekBT5VJzR8JeLcTK0z7b8BTey1NRbGb6wnX3CR0 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Project-Id: 7dc36257d9ff4e7e84d580f830717a28 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Role: admin,member,reader Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Roles: admin,member,reader Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Tenant-Id: 7dc36257d9ff4e7e84d580f830717a28 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-User: tempest-VolumesAdminNegativeTest-328656211-project-admin Apr 11 18:15:58 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:15:58 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:15:58 user devstack@n-api.service[72345]: X-User-Id: e8d7fcfe1ba243d9ae46b3c267734612 Apr 11 18:15:58 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesAdminNegativeTest-328656211-project-admin Apr 11 18:15:58 user devstack@n-api.service[72345]: Apr 11 18:15:58 user devstack@n-api.service[72345]: {"volumeAttachment": {"volumeId": "57be660e-2a28-40ac-8582-96901e9582e0"}} Apr 11 18:15:58 user devstack@n-api.service[72345]: method: > Apr 11 18:15:58 user devstack@n-api.service[72345]: exception: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. Apr 11 18:15:58 user devstack@n-api.service[72345]: action_args: {'server_id': 'db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7', 'id': '7df58904-80cf-4563-a8a4-8e753e6eed96', 'body': {'volumeAttachment': {'volumeId': '57be660e-2a28-40ac-8582-96901e9582e0'}}} Apr 11 18:15:58 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. (HTTP 404) (Request-ID: req-e0ad896a-87cc-4864-8e46-94b82319cb32) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. Apr 11 18:15:58 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:15:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Returning 400 to user: Volume 57be660e-2a28-40ac-8582-96901e9582e0 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:15:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-2727058d-cfee-4966-ba33-958d331571a0 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments/7df58904-80cf-4563-a8a4-8e753e6eed96" status: 400 len: 107 microversion: 2.1 time: 0.278119 Apr 11 18:15:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 135/404] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 18:15:57 2023] PUT /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments/7df58904-80cf-4563-a8a4-8e753e6eed96 => generated 107 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:58 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'services' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:15:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments/7df58904-80cf-4563-a8a4-8e753e6eed96" status: 202 len: 0 microversion: 2.1 time: 0.156181 Apr 11 18:15:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 130/405] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:15:58 2023] DELETE /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments/7df58904-80cf-4563-a8a4-8e753e6eed96 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-066b7233-cf08-49c0-bd9a-927bcbe7701f tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047098 Apr 11 18:15:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 141/406] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:15:58 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.076803 Apr 11 18:15:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 136/407] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:15:59 2023] POST /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:15:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:15:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-18c0a1e6-1cd3-4a3a-8618-c8cabb61062f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.100342 Apr 11 18:15:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 131/408] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:15:59 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Creating event network-vif-unplugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028438 Apr 11 18:16:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:01 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4f2cbed6-9e66-4fa5-acd7-f9306ebb737f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.310254 Apr 11 18:16:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 142/410] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:01 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:01 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b23019e4-30ca-4efb-8769-79eb90f0ac5c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.193519 Apr 11 18:16:01 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 132/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:01 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}, {"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}, {"name": "network-changed", "server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}, {"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}, {"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Creating event network-changed:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Creating event network-changed:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:16:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.035070 Apr 11 18:16:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:04 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-17e144bb-6c1e-4c64-8813-c8d3b6eb0006 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 200 len: 1539 microversion: 2.1 time: 0.297785 Apr 11 18:16:04 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 143/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:03 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=15 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:08 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9cfa2b33-756e-41e6-8715-35ccd7c20b00 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1501 microversion: 2.1 time: 0.161970 Apr 11 18:16:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 133/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:08 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=15 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:12 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d1703ca8-8d4f-40b9-bbe8-af777fe13c84 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044521 Apr 11 18:16:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 139/415] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:16:12 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HTTP exception thrown: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 is not attached to volume 66e98e6d-f7ea-48df-a28b-c9148c90317e Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Request method failure captured: Apr 11 18:16:12 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments/66e98e6d-f7ea-48df-a28b-c9148c90317e HTTP/1.1 Apr 11 18:16:12 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:16:12 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:16:12 user devstack@n-api.service[72344]: Connection: close Apr 11 18:16:12 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:16:12 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:16:12 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:16:12 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:16:12 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaK_tCq0GvSk-CGBQ-2VHdeNLqtzXCBP77t0Bz7GhYB4hpjmPfMQggQalZBb7GOlOAxn9jDU9Y0CKtreMg0zJ5ogd8Whb3zedvIPC1iXZquTbV908Bj7et0TJmgEoqSoo78UMPcT8omRUGl9YX1lCTw8wetWWpLmEGbxe1hFGK_5Yc8 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Project-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Tenant: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Tenant-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-User: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:16:12 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:16:12 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:16:12 user devstack@n-api.service[72344]: X-User-Id: dd1c4ded6c544d6eb16e9086c6259750 Apr 11 18:16:12 user devstack@n-api.service[72344]: X-User-Name: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:16:12 user devstack@n-api.service[72344]: method: > Apr 11 18:16:12 user devstack@n-api.service[72344]: exception: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 is not attached to volume 66e98e6d-f7ea-48df-a28b-c9148c90317e Apr 11 18:16:12 user devstack@n-api.service[72344]: action_args: {'server_id': '2e78a3ea-f132-4da0-81f1-d6745390b0d6', 'id': '66e98e6d-f7ea-48df-a28b-c9148c90317e'} Apr 11 18:16:12 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 66e98e6d-f7ea-48df-a28b-c9148c90317e. Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 is not attached to volume 66e98e6d-f7ea-48df-a28b-c9148c90317e Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 is not attached to volume 66e98e6d-f7ea-48df-a28b-c9148c90317e Apr 11 18:16:12 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Returning 404 to user: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 is not attached to volume 66e98e6d-f7ea-48df-a28b-c9148c90317e {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:16:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-24844acc-9e18-44b4-ac20-97bfac8b6955 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments/66e98e6d-f7ea-48df-a28b-c9148c90317e" status: 404 len: 154 microversion: 2.1 time: 0.139100 Apr 11 18:16:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 144/416] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:16:12 2023] DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6/os-volume_attachments/66e98e6d-f7ea-48df-a28b-c9148c90317e => generated 154 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:16:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 204 len: 0 microversion: 2.1 time: 0.135513 Apr 11 18:16:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 134/417] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:16:13 2023] DELETE /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:14 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-2cee8051-f738-45cb-94bf-31344b5cd228 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 200 len: 1542 microversion: 2.1 time: 0.190131 Apr 11 18:16:14 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:13 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 1542 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Creating event network-vif-unplugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:16:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033595 Apr 11 18:16:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 145/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-deleted", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] Creating event network-vif-deleted:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:16:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Apr 11 18:16:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 135/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:16 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78a3ea-f132-4da0-81f1-d6745390b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f1432e1-1448-4815-a940-c004344002a0"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Creating event network-vif-plugged:9f1432e1-1448-4815-a940-c004344002a0 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 on user Apr 11 18:16:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028891 Apr 11 18:16:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:17 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'services' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:16:17 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments/7d656453-9ad5-4870-b6af-cf2022addc76" status: 202 len: 0 microversion: 2.1 time: 0.187585 Apr 11 18:16:17 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 146/422] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:16:17 2023] DELETE /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments/7d656453-9ad5-4870-b6af-cf2022addc76 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:17 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-47806d94-d646-4b56-b1f8-7df00f197b65 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Apr 11 18:16:17 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 136/423] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:16:17 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=13 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:30 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:31 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:16:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe" status: 204 len: 0 microversion: 2.1 time: 0.121566 Apr 11 18:16:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:16:30 2023] DELETE /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=5 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:31 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a8dda134b46e4bd1ebf41c01cf218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a391811fbc45a4a36f4fa1a63cee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c1a60ab1-5107-4ed3-b401-a559dd14b3fd tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe" status: 200 len: 1460 microversion: 2.1 time: 0.317396 Apr 11 18:16:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 147/425] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:31 2023] GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe => generated 1460 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-unplugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Creating event network-vif-unplugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038227 Apr 11 18:16:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 137/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] HTTP exception thrown: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Request method failure captured: Apr 11 18:16:32 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e HTTP/1.1 Apr 11 18:16:32 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:16:32 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:16:32 user devstack@n-api.service[72345]: Connection: close Apr 11 18:16:32 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:16:32 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:16:32 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:16:32 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:16:32 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNbsmwxAI8wmFpMW7K8KN3M4U8nJNy5upZCGgsi8CXaeGL7jVFI8aiIFie-DoR2tNb3VsSGaXetgNQF64nnN3uipJgim1ruALSvv3LDBGvYRShGwOi4uPFOpabK18Cs9xpt5kSslb_Qg2BwwaeowWVyrUslA7nlu-_0b2vJ9A60jzw Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Project-Id: bf13b304615f48ab88c64755c2795c99 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesActionsTest-1596862779 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesActionsTest-1596862779 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Tenant-Id: bf13b304615f48ab88c64755c2795c99 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesActionsTest-1596862779 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-User: tempest-VolumesActionsTest-1596862779-project-member Apr 11 18:16:32 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:16:32 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:16:32 user devstack@n-api.service[72345]: X-User-Id: 086769a77da24d95a54c35f917240664 Apr 11 18:16:32 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesActionsTest-1596862779-project-member Apr 11 18:16:32 user devstack@n-api.service[72345]: method: > Apr 11 18:16:32 user devstack@n-api.service[72345]: exception: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. Apr 11 18:16:32 user devstack@n-api.service[72345]: action_args: {'id': '34ce2adc-e171-42fd-8c28-6359d56f612e'} Apr 11 18:16:32 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. Apr 11 18:16:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:16:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Returning 404 to user: Instance 34ce2adc-e171-42fd-8c28-6359d56f612e could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:16:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0862de54-ff61-4707-9832-c09092e73afb tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e" status: 404 len: 111 microversion: 2.1 time: 0.029247 Apr 11 18:16:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:32 2023] GET /compute/v2.1/servers/34ce2adc-e171-42fd-8c28-6359d56f612e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:16:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1416952030", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "a526bfae-fdf9-449e-acc6-1cf2215b735f"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:32 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] validate_networks() for [('a526bfae-fdf9-449e-acc6-1cf2215b735f', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:16:33 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}, {"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}, {"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052099 Apr 11 18:16:33 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 138/428] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting quotas for project bf13b304615f48ab88c64755c2795c99. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting quotas for user 086769a77da24d95a54c35f917240664 and project bf13b304615f48ab88c64755c2795c99. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:16:33 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:16:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.512803 Apr 11 18:16:33 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 148/429] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:16:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:16:33 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a82c2027-8e50-42af-a181-8fca83ab5827 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:33 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a82c2027-8e50-42af-a181-8fca83ab5827 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:34 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-a82c2027-8e50-42af-a181-8fca83ab5827 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a82c2027-8e50-42af-a181-8fca83ab5827 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" status: 200 len: 1208 microversion: 2.1 time: 0.204826 Apr 11 18:16:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:33 2023] GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => generated 1208 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-plugged", "status": "completed", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}, {"server_uuid": "311f2066-14ca-4e4a-b475-7b4314dd45fe", "name": "network-vif-deleted", "tag": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Creating event network-vif-plugged:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Creating event network-vif-deleted:9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe on user Apr 11 18:16:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031018 Apr 11 18:16:35 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 139/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d714e630-b194-4339-b095-5d0439bdad28"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 while it is in vm_state rescued Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Request method failure captured: Apr 11 18:16:37 user devstack@n-api.service[72344]: request: POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/os-volume_attachments HTTP/1.1 Apr 11 18:16:37 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:16:37 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:16:37 user devstack@n-api.service[72344]: Connection: close Apr 11 18:16:37 user devstack@n-api.service[72344]: Content-Length: 74 Apr 11 18:16:37 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:16:37 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:16:37 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:16:37 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ3xoWpA6L6sJDUdOd8AExbBGkGdm0qz8n435SJOLLg4ULs4B7aG2c1bJHYh0qnXRM-k9IQThZm2fiVkH9nH5TCuCTtC9SIEpEvjHnYebgTEEAF0nZuw7F41zUga4NdnvnoJ4ZbX_WODBfNPtfgvtFdKqoTscgLbnT3iQhM1z9hXcU Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Project-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Tenant-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:16:37 user devstack@n-api.service[72344]: X-User: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:16:37 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:16:37 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:16:37 user devstack@n-api.service[72344]: X-User-Id: 908e0b5a1ce14f5cb636eda79ac77f7b Apr 11 18:16:37 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:16:37 user devstack@n-api.service[72344]: Apr 11 18:16:37 user devstack@n-api.service[72344]: {"volumeAttachment": {"volumeId": "d714e630-b194-4339-b095-5d0439bdad28"}} Apr 11 18:16:37 user devstack@n-api.service[72344]: method: > Apr 11 18:16:37 user devstack@n-api.service[72344]: exception: Cannot 'attach_volume' instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 while it is in vm_state rescued Apr 11 18:16:37 user devstack@n-api.service[72344]: action_args: {'server_id': '253a1b67-06b0-4308-a2fc-78f36cda0ab8', 'body': {'volumeAttachment': {'volumeId': 'd714e630-b194-4339-b095-5d0439bdad28'}}} Apr 11 18:16:37 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 while it is in vm_state rescued Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 while it is in vm_state rescued Apr 11 18:16:37 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Returning 409 to user: Cannot 'attach_volume' instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 while it is in vm_state rescued {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:16:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f59ba4d7-0335-41c7-ada7-797c8cd2491a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048285 Apr 11 18:16:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 149/432] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:16:37 2023] POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/action" status: 202 len: 0 microversion: 2.1 time: 0.074743 Apr 11 18:16:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:16:37 2023] POST /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-187d5179-47ae-4d88-a70b-811db6c3046a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1498 microversion: 2.1 time: 0.177192 Apr 11 18:16:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 140/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:37 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Creating event network-changed:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:16:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029398 Apr 11 18:16:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 150/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:38 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "name": "network-vif-plugged", "status": "completed", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:38 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Creating event network-vif-plugged:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:16:38 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030156 Apr 11 18:16:38 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 146/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Creating event network-vif-unplugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030177 Apr 11 18:16:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 141/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:40 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "name": "network-vif-plugged", "status": "completed", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:40 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:40 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Creating event network-vif-plugged:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:16:40 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Apr 11 18:16:40 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 151/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:40 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-unplugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:16:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.035579 Apr 11 18:16:40 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 18:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-11997109-92e2-4870-9471-a9dc97833ce7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101001 Apr 11 18:16:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 142/440] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:16:46 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Creating event network-changed:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:16:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034913 Apr 11 18:16:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 152/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0263578e-6765-4a9f-921c-31d9cca13c86 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/ips" status: 200 len: 143 microversion: 2.1 time: 0.046062 Apr 11 18:16:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:16:48 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/ips => generated 143 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e495e0aa-c9ba-4331-b940-cce367f34d04 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045040 Apr 11 18:16:48 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 143/443] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:16:48 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:16:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-909573337", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "bff39075-a0de-4117-8653-a12c13830d54"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:48 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] validate_networks() for [('bff39075-a0de-4117-8653-a12c13830d54', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting quotas for user d20726e00e3743168e32eafe43318e20 and project ad8dd512b7424fbe996ecbd18d11471e. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:16:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:16:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.604448 Apr 11 18:16:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 153/444] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:16:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:16:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-68e207a8-9eec-4240-926c-7e2b3195e0da tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:49 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-68e207a8-9eec-4240-926c-7e2b3195e0da tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:49 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-68e207a8-9eec-4240-926c-7e2b3195e0da tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-68e207a8-9eec-4240-926c-7e2b3195e0da tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243" status: 200 len: 1211 microversion: 2.1 time: 0.070575 Apr 11 18:16:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:49 2023] GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 => generated 1211 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fcd6aab-4190-481d-bea1-4aff73c18083"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304158 Apr 11 18:16:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 144/446] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:16:49 2023] POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Creating event network-changed:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:16:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030068 Apr 11 18:16:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 154/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-5b9c1e00-4a8a-4a8e-8207-4329cfedcc9f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.091962 Apr 11 18:16:53 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 150/448] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:16:53 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:16:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Creating event network-changed:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:16:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045154 Apr 11 18:16:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 145/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-7ae8fe29-8184-41b7-bc15-46d843cc92ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/ips" status: 200 len: 110 microversion: 2.20 time: 0.037339 Apr 11 18:16:54 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 155/450] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 18:16:54 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:16:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:16:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Apr 11 18:16:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 151/451] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:55 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'flavor' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:16:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/action" status: 202 len: 0 microversion: 2.20 time: 0.814288 Apr 11 18:16:56 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 146/452] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:16:55 2023] POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-dfa42e69-d653-4e85-8083-85d9273ab320 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1711 microversion: 2.20 time: 0.190227 Apr 11 18:16:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 156/453] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:16:56 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:16:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-unplugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Creating event network-vif-unplugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:16:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036604 Apr 11 18:16:56 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 152/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:16:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031545 Apr 11 18:16:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 147/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Going to try to stop instance {{(pid=72344) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 18:16:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action" status: 202 len: 0 microversion: 2.1 time: 0.188588 Apr 11 18:16:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 157/456] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:16:57 2023] POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:58 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:16:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b45e60df-d867-4704-97ba-a67a7a4eb324 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1710 microversion: 2.1 time: 0.162960 Apr 11 18:16:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:16:57 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:16:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-unplugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Creating event network-vif-unplugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:16:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034245 Apr 11 18:16:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 148/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:16:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:16:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:16:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:16:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:16:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:16:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Apr 11 18:16:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 158/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:16:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:00 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:17:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047344 Apr 11 18:17:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 154/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=25 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:01 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'services' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:17:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments/e18a0321-da20-41e7-b97b-7350ae176fc5" status: 202 len: 0 microversion: 2.1 time: 0.174770 Apr 11 18:17:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 149/461] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:17:01 2023] DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments/e18a0321-da20-41e7-b97b-7350ae176fc5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:02 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-76ceaf39-e3a9-46c2-86b6-b74b83044c3a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057035 Apr 11 18:17:02 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 159/462] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:17:02 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Creating event network-changed:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:17:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Apr 11 18:17:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 155/463] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HTTP exception thrown: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Request method failure captured: Apr 11 18:17:04 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 HTTP/1.1 Apr 11 18:17:04 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:17:04 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:17:04 user devstack@n-api.service[72343]: Connection: close Apr 11 18:17:04 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:17:04 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:17:04 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:17:04 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:17:04 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaK_tCq0GvSk-CGBQ-2VHdeNLqtzXCBP77t0Bz7GhYB4hpjmPfMQggQalZBb7GOlOAxn9jDU9Y0CKtreMg0zJ5ogd8Whb3zedvIPC1iXZquTbV908Bj7et0TJmgEoqSoo78UMPcT8omRUGl9YX1lCTw8wetWWpLmEGbxe1hFGK_5Yc8 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Project-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Tenant: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Tenant-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-User: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:17:04 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:17:04 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:17:04 user devstack@n-api.service[72343]: X-User-Id: dd1c4ded6c544d6eb16e9086c6259750 Apr 11 18:17:04 user devstack@n-api.service[72343]: X-User-Name: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:17:04 user devstack@n-api.service[72343]: method: > Apr 11 18:17:04 user devstack@n-api.service[72343]: exception: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. Apr 11 18:17:04 user devstack@n-api.service[72343]: action_args: {'id': '2e78a3ea-f132-4da0-81f1-d6745390b0d6'} Apr 11 18:17:04 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. Apr 11 18:17:04 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:17:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Returning 404 to user: Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:17:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-38ca20ad-dbab-4e09-bb04-fdb7e490ab91 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6" status: 404 len: 111 microversion: 2.1 time: 0.127732 Apr 11 18:17:04 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 150/464] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:04 2023] GET /compute/v2.1/servers/2e78a3ea-f132-4da0-81f1-d6745390b0d6 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:17:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3ba488e1-69b9-4049-b552-a8e3c3879af0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '.version_select at 0x7fadb97f9a20>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-3ba488e1-69b9-4049-b552-a8e3c3879af0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430519022" status: 202 len: 0 microversion: 2.1 time: 0.026857 Apr 11 18:17:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 156/465] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 18:17:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430519022 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:17:04 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-021da857-e409-4dd5-b7f2-345f6fcfcdf0 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 200 len: 1539 microversion: 2.1 time: 0.156332 Apr 11 18:17:04 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 160/466] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:04 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f60a7e6e-7053-4db2-960b-9f137ec2dd4b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: .version_select at 0x7fadb9707c70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-654518614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0dOv+vq9gsgidD6e8GZkhomJp382UjYsmrw934PhdaAUHmUcG7KAhr8HRtwnN2nsKzabe5u5w0n4NM+BgKevuPnPr+IH9jOhoaX2NUYaoSjcye13Ow4Y+ibxlYeX9n8Q=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-f60a7e6e-7053-4db2-960b-9f137ec2dd4b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for project a70e133c013140e1a17804737f4e3ef7. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-f60a7e6e-7053-4db2-960b-9f137ec2dd4b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for user dd1c4ded6c544d6eb16e9086c6259750 and project a70e133c013140e1a17804737f4e3ef7. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:17:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f60a7e6e-7053-4db2-960b-9f137ec2dd4b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048934 Apr 11 18:17:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 151/467] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:17:06 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1412604929", "imageRef": "ae202131-1e90-4b52-a842-aa146ab12536", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-654518614", "networks": [{"uuid": "bd1220d9-28b4-4637-b373-8e8e6cc4131f"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:06 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] validate_networks() for [('bd1220d9-28b4-4637-b373-8e8e6cc4131f', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:17:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Creating event network-changed:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:17:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031364 Apr 11 18:17:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 161/468] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30162a26-a276-44ab-8f84-434ae2dde3e9"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295460 Apr 11 18:17:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 152/469] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:17:06 2023] POST /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:07 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-50c58942-5081-44b6-b07f-013d006feb47 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051780 Apr 11 18:17:07 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 162/470] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:17:07 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for project a70e133c013140e1a17804737f4e3ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting quotas for user dd1c4ded6c544d6eb16e9086c6259750 and project a70e133c013140e1a17804737f4e3ef7. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae202131-1e90-4b52-a842-aa146ab12536',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:17:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.489642 Apr 11 18:17:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 157/471] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:17:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:17:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-971add2c-fd35-4d21-89cb-188ed128970e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-971add2c-fd35-4d21-89cb-188ed128970e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:08 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-971add2c-fd35-4d21-89cb-188ed128970e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-971add2c-fd35-4d21-89cb-188ed128970e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1252 microversion: 2.1 time: 0.123917 Apr 11 18:17:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 153/472] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:08 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1252 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72344) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 18:17:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c/action" status: 202 len: 0 microversion: 2.1 time: 0.125887 Apr 11 18:17:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 163/473] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:17:08 2023] POST /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:08 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-68fe3809-6ce3-4d4f-ad7f-5f393598ff63 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1509 microversion: 2.1 time: 0.192420 Apr 11 18:17:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 158/474] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:08 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-609e5991-72f0-4c10-96bd-28fd2aaef2bb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '.version_select at 0x7fadb9667be0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-609e5991-72f0-4c10-96bd-28fd2aaef2bb tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c" status: 204 len: 0 microversion: 2.1 time: 0.262877 Apr 11 18:17:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 154/475] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:08 2023] DELETE /compute/v2.1/images/06e3ca91-1344-4d75-bb85-d0666535be8c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:17:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 204 len: 0 microversion: 2.1 time: 0.116560 Apr 11 18:17:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 164/476] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:17:09 2023] DELETE /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:09 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-872d8ab4-2f93-4d72-b9f3-2dc8dd225117 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 200 len: 1676 microversion: 2.1 time: 0.256975 Apr 11 18:17:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:09 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Creating event network-vif-unplugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:17:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037524 Apr 11 18:17:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 155/478] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Creating event network-changed:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:17:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Apr 11 18:17:11 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 165/479] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-plugged", "status": "completed", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}, {"server_uuid": "1f3000ca-5a67-4814-bf9d-94415c8f3d9d", "name": "network-vif-deleted", "tag": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Creating event network-vif-plugged:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:17:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Creating event network-vif-deleted:8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d on user Apr 11 18:17:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030533 Apr 11 18:17:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 160/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:17:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035322 Apr 11 18:17:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 156/481] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:17:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028458 Apr 11 18:17:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 166/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:15 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'services' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:17:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Creating event network-changed:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:17:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030635 Apr 11 18:17:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 157/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments/30162a26-a276-44ab-8f84-434ae2dde3e9" status: 202 len: 0 microversion: 2.1 time: 0.196489 Apr 11 18:17:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 161/484] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:17:15 2023] DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments/30162a26-a276-44ab-8f84-434ae2dde3e9 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-11016b44-fe54-4f55-820f-10d5d3b58e59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057123 Apr 11 18:17:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 167/485] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:17:16 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:17:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035816 Apr 11 18:17:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 158/486] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] HTTP exception thrown: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Request method failure captured: Apr 11 18:17:21 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe HTTP/1.1 Apr 11 18:17:21 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:17:21 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:17:21 user devstack@n-api.service[72345]: Connection: close Apr 11 18:17:21 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:17:21 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:17:21 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:17:21 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:17:21 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaONeNJ3BTrg7_D_toVTeemTE8eVlulwDvL8-47Z3dyBzl7UoCfkqVq0Sw7LyrxzuGFh-qJS1IMkrjEeSwnffkIGry7D7zC59mdFWOb0yEqe_B-VGl8WVzoKn92BL7-SxxJDCyJI3V6zmh10RxqG_ShbR5nU0ees06yjjgqtvyaMh-M Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Project-Id: d6a391811fbc45a4a36f4fa1a63cee7f Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesNegativeTest-197324575 Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6a391811fbc45a4a36f4fa1a63cee7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6a391811fbc45a4a36f4fa1a63cee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6a391811fbc45a4a36f4fa1a63cee7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesNegativeTest-197324575 Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Tenant-Id: d6a391811fbc45a4a36f4fa1a63cee7f Apr 11 18:17:21 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesNegativeTest-197324575 Apr 11 18:17:21 user devstack@n-api.service[72345]: X-User: tempest-VolumesNegativeTest-197324575-project-member Apr 11 18:17:21 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:17:21 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:17:21 user devstack@n-api.service[72345]: X-User-Id: 0c4a8dda134b46e4bd1ebf41c01cf218 Apr 11 18:17:21 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesNegativeTest-197324575-project-member Apr 11 18:17:21 user devstack@n-api.service[72345]: method: > Apr 11 18:17:21 user devstack@n-api.service[72345]: exception: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. Apr 11 18:17:21 user devstack@n-api.service[72345]: action_args: {'id': '311f2066-14ca-4e4a-b475-7b4314dd45fe'} Apr 11 18:17:21 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. Apr 11 18:17:21 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:17:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Returning 404 to user: Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:17:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-21884d63-2e7f-4972-bfc9-048d0b3c7a0b tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] 10.0.0.210 "GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe" status: 404 len: 111 microversion: 2.1 time: 0.031944 Apr 11 18:17:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 162/487] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:21 2023] GET /compute/v2.1/servers/311f2066-14ca-4e4a-b475-7b4314dd45fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:17:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:17:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:17:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Apr 11 18:17:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 168/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:24 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9068dc30-e746-432e-9a33-48a9db9d289a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" status: 200 len: 1487 microversion: 2.1 time: 0.256037 Apr 11 18:17:24 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 159/489] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:24 2023] GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:27 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0f67788c-241c-46b8-8d3a-655042b6348b tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1504 microversion: 2.1 time: 0.217410 Apr 11 18:17:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 163/490] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:27 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:39 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2b36a841-8cb0-43d1-a909-c96bc1a9cf8d tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243" status: 200 len: 1495 microversion: 2.1 time: 0.158987 Apr 11 18:17:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 169/491] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:39 2023] GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:46 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9ccb6ab1-cc15-4c0c-a030-ffd64321b794 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1652 microversion: 2.20 time: 0.183697 Apr 11 18:17:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 160/492] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:17:46 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:48 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b8c2ad66-8bc3-4dc3-9641-09d1f52822a9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1687 microversion: 2.1 time: 0.158880 Apr 11 18:17:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 164/493] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:48 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-65c31594-a9bb-4626-8427-bea5a5aef04c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045699 Apr 11 18:17:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 170/494] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:17:52 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-394192ff-8719-40d4-a59b-273d1ba7075c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1674 microversion: 2.1 time: 0.148507 Apr 11 18:17:52 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 161/495] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:52 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-eb62a9cf-2075-45bb-91cc-b76149179f0d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1674 microversion: 2.1 time: 0.171779 Apr 11 18:17:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:52 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:52 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e3ba0691-70e6-4b89-9ac8-48900f318645 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1674 microversion: 2.1 time: 0.149177 Apr 11 18:17:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 171/497] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:52 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:58 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-1a229b9c-f4f1-4d1b-a19f-a655af7ae67a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1536 microversion: 2.1 time: 0.143290 Apr 11 18:17:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 162/498] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:58 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1536 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:58 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:17:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8f81c5b5-4cb1-44da-8190-1f503c185770 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1554 microversion: 2.1 time: 0.214573 Apr 11 18:17:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 166/499] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:58 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:17:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] HTTP exception thrown: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Request method failure captured: Apr 11 18:17:59 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d HTTP/1.1 Apr 11 18:17:59 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:17:59 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:17:59 user devstack@n-api.service[72344]: Connection: close Apr 11 18:17:59 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:17:59 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:17:59 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:17:59 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:17:59 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ31-TZzaqZATY8Y6c4xsh241IcZ0BNM-TVBHTswyqJVNengFTi0cpFwLt_dJINAxh5wh1jE-tC2p-H_imHYwwxG3tUA8hbTrh7rpQF9ydABlqpL-J2VzJ7kXI83TeAGTROhoadRFyuovjlM3z4CzoF_VFGPaT_x6lujc1sDktYLtI Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Project-Id: 964624241aac4d7ba6b2b9ffca6e7d8a Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerStableDeviceRescueTest-465398083 Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/964624241aac4d7ba6b2b9ffca6e7d8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/964624241aac4d7ba6b2b9ffca6e7d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/964624241aac4d7ba6b2b9ffca6e7d8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerStableDeviceRescueTest-465398083 Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Tenant-Id: 964624241aac4d7ba6b2b9ffca6e7d8a Apr 11 18:17:59 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-465398083 Apr 11 18:17:59 user devstack@n-api.service[72344]: X-User: tempest-ServerStableDeviceRescueTest-465398083-project-member Apr 11 18:17:59 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:17:59 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:17:59 user devstack@n-api.service[72344]: X-User-Id: 1e62201c2b4e4763bae71280d81ff5e4 Apr 11 18:17:59 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerStableDeviceRescueTest-465398083-project-member Apr 11 18:17:59 user devstack@n-api.service[72344]: method: > Apr 11 18:17:59 user devstack@n-api.service[72344]: exception: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. Apr 11 18:17:59 user devstack@n-api.service[72344]: action_args: {'id': '1f3000ca-5a67-4814-bf9d-94415c8f3d9d'} Apr 11 18:17:59 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. Apr 11 18:17:59 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:17:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Returning 404 to user: Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:17:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8bf98ba4-ae4b-470e-9f1a-5589a8afa13b tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d" status: 404 len: 111 microversion: 2.1 time: 0.028607 Apr 11 18:17:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 172/500] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:17:59 2023] GET /compute/v2.1/servers/1f3000ca-5a67-4814-bf9d-94415c8f3d9d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:17:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-4979f5b7-2a6c-4b3e-990d-9f90a31502e2 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Calling method '.version_select at 0x7fadb9664ca0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:17:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-4979f5b7-2a6c-4b3e-990d-9f90a31502e2 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352570335" status: 202 len: 0 microversion: 2.1 time: 0.028877 Apr 11 18:17:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 163/501] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:17:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352570335 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-2a8501fe-b394-497d-9a59-c04bc7cfef59 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052949 Apr 11 18:18:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 167/502] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:18:06 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-746341945"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/action" status: 202 len: 0 microversion: 2.1 time: 0.803170 Apr 11 18:18:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 173/503] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:18:07 2023] POST /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=18 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2124334392", "imageRef": "041c5dfa-75b5-40fd-88b4-c15489d9c57b", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1363613236", "security_groups": [{"name": "tempest-secgroup-smoke-417180555"}], "networks": [{"uuid": "6c15015e-33ba-4615-94fd-f8253338eb8a"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] validate_networks() for [('6c15015e-33ba-4615-94fd-f8253338eb8a', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for project 86e02898b1bc4378822244d9522ff042. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting quotas for user c44e6b75d86f4ff0b6f93123ce15ccc0 and project 86e02898b1bc4378822244d9522ff042. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:18:15 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='041c5dfa-75b5-40fd-88b4-c15489d9c57b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:18:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.660840 Apr 11 18:18:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 164/504] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:18:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:18:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-adb83069-dd02-47c2-a8c2-315d3e8d8d8a tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-adb83069-dd02-47c2-a8c2-315d3e8d8d8a tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:15 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-adb83069-dd02-47c2-a8c2-315d3e8d8d8a tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-adb83069-dd02-47c2-a8c2-315d3e8d8d8a tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 200 len: 1237 microversion: 2.1 time: 0.072281 Apr 11 18:18:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 168/505] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:15 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Creating event network-changed:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:18:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045723 Apr 11 18:18:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 174/506] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:21 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "name": "network-vif-plugged", "status": "completed", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Creating event network-vif-plugged:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:18:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036162 Apr 11 18:18:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 165/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "name": "network-vif-plugged", "status": "completed", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=24 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=13 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Creating event network-vif-plugged:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:18:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043516 Apr 11 18:18:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 169/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:25 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:18:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" status: 204 len: 0 microversion: 2.1 time: 0.130083 Apr 11 18:18:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 175/509] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:18:25 2023] DELETE /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:25 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-4fc41236-ef1b-48f9-b5c9-cebd62bff193 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" status: 200 len: 1493 microversion: 2.1 time: 0.245984 Apr 11 18:18:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 166/510] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:25 2023] GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "name": "network-vif-unplugged", "status": "completed", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Creating event network-vif-unplugged:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:18:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034624 Apr 11 18:18:25 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 170/511] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:18:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "name": "network-vif-deleted", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] Creating event network-vif-deleted:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:18:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044234 Apr 11 18:18:26 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 176/512] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df", "name": "network-vif-plugged", "status": "completed", "tag": "bca9e38b-190a-4007-9778-58c7a8578078"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Creating event network-vif-plugged:bca9e38b-190a-4007-9778-58c7a8578078 for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df on user Apr 11 18:18:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Apr 11 18:18:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 167/513] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e4eedae9-65e8-41d2-9a74-21056a7c9e00 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: .version_select at 0x7fadb967a9e0>, body: {"keypair": {"name": "tempest-keypair-1641901033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIK5aPskfsOVBBGyw4yEbsLtMQvwJFTLOan+Twhh4tjr/C3BYu6u/4BceyXCRAua8zDa2ccvRw2H6FAdWFmjwazVukCovMZ6BukRUwqQ+pfLxuRzbwDkNupsMXFG9o8Q=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:29 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-e4eedae9-65e8-41d2-9a74-21056a7c9e00 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:18:29 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-e4eedae9-65e8-41d2-9a74-21056a7c9e00 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for user 908e0b5a1ce14f5cb636eda79ac77f7b and project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:18:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e4eedae9-65e8-41d2-9a74-21056a7c9e00 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044032 Apr 11 18:18:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 171/514] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:18:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2027322626", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0c782c31-14df-4b47-a7bc-3191698e4825"}], "security_groups": [{"name": "tempest-securitygroup--594565362"}], "key_name": "tempest-keypair-1641901033", "user_data": "}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] validate_networks() for [('0c782c31-14df-4b47-a7bc-3191698e4825', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting quotas for user 908e0b5a1ce14f5cb636eda79ac77f7b and project c10b5a531bbc41d680d137a766a8b2d9. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:18:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:18:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.597010 Apr 11 18:18:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 177/515] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:18:31 2023] POST /compute/v2.1/servers => generated 406 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:18:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-91bc50aa-3561-4481-9a0a-e40bef29044c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:31 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-91bc50aa-3561-4481-9a0a-e40bef29044c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:31 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-91bc50aa-3561-4481-9a0a-e40bef29044c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-91bc50aa-3561-4481-9a0a-e40bef29044c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1240 microversion: 2.1 time: 0.069408 Apr 11 18:18:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 168/516] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:31 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Creating event network-changed:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:18:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028525 Apr 11 18:18:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 172/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:36 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:36 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:18:36 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 Apr 11 18:18:36 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 178/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:38 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:18:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029189 Apr 11 18:18:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 169/519] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "221d2df7-fcfa-446b-8ec3-45fec46bc739"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] HTTP exception thrown: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Request method failure captured: Apr 11 18:18:41 user devstack@n-api.service[72345]: request: PUT /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243/os-volume_attachments/cbf314c8-7f7b-4880-ab41-3072e17ede00 HTTP/1.1 Apr 11 18:18:41 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:18:41 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:18:41 user devstack@n-api.service[72345]: Connection: close Apr 11 18:18:41 user devstack@n-api.service[72345]: Content-Length: 74 Apr 11 18:18:41 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:18:41 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:18:41 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:18:41 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNiIDrNVl3hzaI7S4Hnw915dbCUCwfMkt79PQOyokEbwlYZCrMkpcnRiBWZdrajKkbvUKeCAQGK3QeSskZtW00FwQcAqi4wCkedAkOpx82AuPPFA_bHJ5bPV0uJK-BxiP50nfw0ekBT5VJzR8JeLcTK0z7b8BTey1NRbGb6wnX3CR0 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Project-Id: 7dc36257d9ff4e7e84d580f830717a28 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Role: admin,member,reader Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Roles: admin,member,reader Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7dc36257d9ff4e7e84d580f830717a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Tenant-Id: 7dc36257d9ff4e7e84d580f830717a28 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-328656211 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-User: tempest-VolumesAdminNegativeTest-328656211-project-admin Apr 11 18:18:41 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:18:41 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:18:41 user devstack@n-api.service[72345]: X-User-Id: e8d7fcfe1ba243d9ae46b3c267734612 Apr 11 18:18:41 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesAdminNegativeTest-328656211-project-admin Apr 11 18:18:41 user devstack@n-api.service[72345]: Apr 11 18:18:41 user devstack@n-api.service[72345]: {"volumeAttachment": {"volumeId": "221d2df7-fcfa-446b-8ec3-45fec46bc739"}} Apr 11 18:18:41 user devstack@n-api.service[72345]: method: > Apr 11 18:18:41 user devstack@n-api.service[72345]: exception: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. Apr 11 18:18:41 user devstack@n-api.service[72345]: action_args: {'server_id': '2fdbfe12-0376-480d-a63d-7db4a2ac2243', 'id': 'cbf314c8-7f7b-4880-ab41-3072e17ede00', 'body': {'volumeAttachment': {'volumeId': '221d2df7-fcfa-446b-8ec3-45fec46bc739'}}} Apr 11 18:18:41 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. (HTTP 404) (Request-ID: req-78b05092-c585-4370-b908-cea4c1cb518c) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. Apr 11 18:18:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:18:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] Returning 404 to user: Volume cbf314c8-7f7b-4880-ab41-3072e17ede00 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:18:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-62526332-293d-4161-9f9a-e6756ded4a25 tempest-VolumesAdminNegativeTest-328656211 tempest-VolumesAdminNegativeTest-328656211-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243/os-volume_attachments/cbf314c8-7f7b-4880-ab41-3072e17ede00" status: 404 len: 109 microversion: 2.1 time: 0.080394 Apr 11 18:18:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 173/520] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 18:18:41 2023] PUT /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243/os-volume_attachments/cbf314c8-7f7b-4880-ab41-3072e17ede00 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:42 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:18:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243" status: 204 len: 0 microversion: 2.1 time: 0.135406 Apr 11 18:18:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 179/521] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:18:42 2023] DELETE /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:42 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7ccd5f64-5024-4f68-956f-5dbec054f4c2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243" status: 200 len: 1501 microversion: 2.1 time: 0.274270 Apr 11 18:18:42 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 170/522] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:42 2023] GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:42 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-unplugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Creating event network-vif-unplugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030672 Apr 11 18:18:42 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 174/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-deleted", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] Creating event network-vif-deleted:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039845 Apr 11 18:18:44 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 180/524] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:44 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}, {"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}, {"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}, {"server_uuid": "2fdbfe12-0376-480d-a63d-7db4a2ac2243", "name": "network-vif-plugged", "status": "completed", "tag": "8fbca9dd-8f56-4336-be2e-7341f550e2a7"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Creating event network-vif-plugged:8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 on user Apr 11 18:18:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036129 Apr 11 18:18:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 171/525] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cec3ad28-d4ef-47b1-8fb0-4e979af79136"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c5b46657-8802-4472-9e19-24e286700fd1 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366075 Apr 11 18:18:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 175/526] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 18:18:47 2023] POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments => generated 188 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72344) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 18:18:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/action" status: 202 len: 0 microversion: 2.20 time: 0.156854 Apr 11 18:18:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 181/527] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:18:47 2023] POST /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:47 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a1b43862-dfd2-468b-b2c9-b584a015a6fe tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1738 microversion: 2.20 time: 0.208513 Apr 11 18:18:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 172/528] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:18:47 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:18:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:48 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Going to try to start instance {{(pid=72345) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 18:18:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action" status: 202 len: 0 microversion: 2.1 time: 0.123843 Apr 11 18:18:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 176/529] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:18:48 2023] POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:48 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-71cff5d9-32ac-43a4-aa4a-6d8e75682d81 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1696 microversion: 2.1 time: 0.377821 Apr 11 18:18:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 182/530] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:48 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1696 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:18:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Apr 11 18:18:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 173/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:54 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1c5f66f3-e806-4d79-9680-c4ba1b4b0656 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1674 microversion: 2.1 time: 0.759572 Apr 11 18:18:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:54 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1674 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314d5532-2e55-4c33-84fc-47a99b78f74a"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:18:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291176 Apr 11 18:18:55 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 183/533] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:18:54 2023] POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:18:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052933 Apr 11 18:18:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 174/534] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Creating event network-changed:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:18:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034415 Apr 11 18:18:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 178/535] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:58 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3db2633e-734d-4de3-89b0-83541704dfcb tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1536 microversion: 2.1 time: 0.212347 Apr 11 18:18:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 184/536] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:58 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1536 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching by: {'deleted': False, 'project_id': 'a70e133c013140e1a17804737f4e3ef7'} {{(pid=72343) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:58 user devstack@n-api.service[72343]: DEBUG nova.compute.multi_cell_list [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72343) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 18:18:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bfc8d734-6349-43f6-bedd-90cb70e53ccc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.086014 Apr 11 18:18:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 175/537] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 18:18:58 2023] GET /compute/v2.1/servers => generated 341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:18:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:18:59 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:18:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1a18839c-c4c0-49c7-bdca-fca45a770281 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1536 microversion: 2.1 time: 0.173739 Apr 11 18:18:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 179/538] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:18:58 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:18:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1793009425", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "63428a67-aad6-41c0-8022-1c7dbad79e7b"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:18:59 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] validate_networks() for [('63428a67-aad6-41c0-8022-1c7dbad79e7b', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting quotas for project fde6ebc41bed44f1a04e23e62cd9ac0d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting quotas for user 5fdf10ea561448f689cdd2d052080168 and project fde6ebc41bed44f1a04e23e62cd9ac0d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:19:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.769441 Apr 11 18:19:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 185/539] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:18:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-60d533d6-5e2f-41c4-bac4-3e7b4ed4dd6f tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-60d533d6-5e2f-41c4-bac4-3e7b4ed4dd6f tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Creating event network-changed:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:19:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:19:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Apr 11 18:19:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 186/540] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-60d533d6-5e2f-41c4-bac4-3e7b4ed4dd6f tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-60d533d6-5e2f-41c4-bac4-3e7b4ed4dd6f tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd" status: 200 len: 1213 microversion: 2.1 time: 0.093440 Apr 11 18:19:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 176/541] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:00 2023] GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 204 len: 0 microversion: 2.1 time: 0.231547 Apr 11 18:19:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:19:00 2023] DELETE /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3861b91-6351-4328-8e27-bbffbd356684"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:00 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c45eb41d-5e9f-4f82-926f-2b4dd1027cf9 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 200 len: 1560 microversion: 2.1 time: 0.370996 Apr 11 18:19:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 187/543] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:00 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 1560 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439355 Apr 11 18:19:01 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 177/544] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:19:00 2023] POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}, {"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Creating event network-vif-unplugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:19:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Creating event network-vif-plugged:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:19:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.055367 Apr 11 18:19:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 181/545] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Old instance type m1.nano, new instance type m1.micro {{(pid=72344) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'ram', 'cores'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'ram', 'cores'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:19:03 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:19:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action" status: 202 len: 0 microversion: 2.1 time: 0.270806 Apr 11 18:19:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 188/546] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:19:03 2023] POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:03 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9a92ad8b-dfed-488f-98cb-d1cf914a7c93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1729 microversion: 2.1 time: 0.395157 Apr 11 18:19:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 178/547] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:03 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Creating event network-changed:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:19:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034879 Apr 11 18:19:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 182/548] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:19:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Apr 11 18:19:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 189/549] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:06 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ee25afd7-83d0-4101-8283-3a8078918690 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 200 len: 1539 microversion: 2.1 time: 0.177281 Apr 11 18:19:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 179/550] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:05 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:19:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Apr 11 18:19:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fef8f1e-9300-4bd6-8958-4386541a9c0c", "name": "network-vif-deleted", "tag": "d870c097-5a51-464e-94e5-d29336bee09d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] Creating event network-vif-deleted:d870c097-5a51-464e-94e5-d29336bee09d for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c on user Apr 11 18:19:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039198 Apr 11 18:19:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 190/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-unplugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Creating event network-vif-unplugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:19:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:19:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064666 Apr 11 18:19:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 180/553] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:11 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-83d2b4dc-42b2-46bf-9e6a-98e69b684bdc tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1582 microversion: 2.1 time: 0.204472 Apr 11 18:19:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:11 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1582 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}, {"server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "name": "network-vif-plugged", "status": "completed", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}, {"server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "name": "network-vif-plugged", "status": "completed", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:19:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Creating event network-vif-plugged:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:19:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Creating event network-vif-plugged:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:19:12 user devstack@n-api.service[72344]: DEBUG nova.compute.api [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72344) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:19:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.085541 Apr 11 18:19:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 191/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:13 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Creating event network-changed:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072821 Apr 11 18:19:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 181/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-829198473"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72345]: INFO nova.network.security_group_api [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Adding security group 0b5d3c4e-1b54-4ced-875d-37aab51525a9 to port 23c3497e-9e98-496c-b81b-3ce400105b1b Apr 11 18:19:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-dbb8b2c5-6ffa-4fa5-b87d-f437943061ea tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action" status: 202 len: 0 microversion: 2.1 time: 0.613542 Apr 11 18:19:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 185/557] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:19:14 2023] POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=5 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Creating event network-changed:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Apr 11 18:19:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 192/558] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] HTTP exception thrown: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Request method failure captured: Apr 11 18:19:15 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df HTTP/1.1 Apr 11 18:19:15 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:19:15 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:19:15 user devstack@n-api.service[72345]: Connection: close Apr 11 18:19:15 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:19:15 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:19:15 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:19:15 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:19:15 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNbsmwxAI8wmFpMW7K8KN3M4U8nJNy5upZCGgsi8CXaeGL7jVFI8aiIFie-DoR2tNb3VsSGaXetgNQF64nnN3uipJgim1ruALSvv3LDBGvYRShGwOi4uPFOpabK18Cs9xpt5kSslb_Qg2BwwaeowWVyrUslA7nlu-_0b2vJ9A60jzw Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Project-Id: bf13b304615f48ab88c64755c2795c99 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesActionsTest-1596862779 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf13b304615f48ab88c64755c2795c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesActionsTest-1596862779 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Tenant-Id: bf13b304615f48ab88c64755c2795c99 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesActionsTest-1596862779 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-User: tempest-VolumesActionsTest-1596862779-project-member Apr 11 18:19:15 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:19:15 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:19:15 user devstack@n-api.service[72345]: X-User-Id: 086769a77da24d95a54c35f917240664 Apr 11 18:19:15 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesActionsTest-1596862779-project-member Apr 11 18:19:15 user devstack@n-api.service[72345]: method: > Apr 11 18:19:15 user devstack@n-api.service[72345]: exception: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. Apr 11 18:19:15 user devstack@n-api.service[72345]: action_args: {'id': '9b2e9f51-531f-4f4c-a1ce-75e2cfd337df'} Apr 11 18:19:15 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. Apr 11 18:19:15 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Returning 404 to user: Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:19:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a5b6e74c-374a-46e1-b8f7-240a6b3c6c16 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" status: 404 len: 111 microversion: 2.1 time: 0.156955 Apr 11 18:19:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 186/559] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:15 2023] GET /compute/v2.1/servers/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:19:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-48b5bd19-36d6-4722-994c-175a9a1821f0 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1747 microversion: 2.1 time: 0.212447 Apr 11 18:19:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 182/560] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:15 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1747 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action" status: 202 len: 0 microversion: 2.1 time: 0.120244 Apr 11 18:19:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 193/561] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:19:15 2023] POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:16 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f05d31d3-fc54-47de-a4f0-f39fe95d6818 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1739 microversion: 2.1 time: 0.240252 Apr 11 18:19:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 187/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:15 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-unplugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=24 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Creating event network-vif-unplugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032678 Apr 11 18:19:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 183/563] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044973 Apr 11 18:19:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 194/564] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:22 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8b8c6438-b560-4ec1-89e2-b17a4921c8b6 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1553 microversion: 2.1 time: 0.420523 Apr 11 18:19:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 188/565] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:21 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}, {"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:19:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113512 Apr 11 18:19:23 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 184/566] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}, {"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:19:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:19:25 user devstack@n-api.service[72344]: DEBUG nova.compute.api [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72344) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:19:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078696 Apr 11 18:19:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 195/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:33 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:33 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] HTTP exception thrown: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Request method failure captured: Apr 11 18:19:34 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 HTTP/1.1 Apr 11 18:19:34 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:19:34 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:19:34 user devstack@n-api.service[72345]: Connection: close Apr 11 18:19:34 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:19:34 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:19:34 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:19:34 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:19:34 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaNbZzkSfeD-l8DKAsPgFpsXCNfSuVT9S0ZLrHjNDhsdyB2oIFIftYNGkxdW6Vj0q0O0H2tfaGvEyORJgKtzqk6d8Dbtc3K0_ysDZX2TVxZzw4cQkjBnfA4yPtm75cJaEwpcc1k3bzqooG3T9yeqdMBTiRdRa5lU4z2MWaCW7BDAwMI Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Project-Id: ad8dd512b7424fbe996ecbd18d11471e Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Project-Name: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Tenant: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Tenant-Id: ad8dd512b7424fbe996ecbd18d11471e Apr 11 18:19:34 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:19:34 user devstack@n-api.service[72345]: X-User: tempest-VolumesAdminNegativeTest-298923704-project-member Apr 11 18:19:34 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:19:34 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:19:34 user devstack@n-api.service[72345]: X-User-Id: d20726e00e3743168e32eafe43318e20 Apr 11 18:19:34 user devstack@n-api.service[72345]: X-User-Name: tempest-VolumesAdminNegativeTest-298923704-project-member Apr 11 18:19:34 user devstack@n-api.service[72345]: method: > Apr 11 18:19:34 user devstack@n-api.service[72345]: exception: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. Apr 11 18:19:34 user devstack@n-api.service[72345]: action_args: {'id': '2fdbfe12-0376-480d-a63d-7db4a2ac2243'} Apr 11 18:19:34 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. Apr 11 18:19:34 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Returning 404 to user: Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:19:34 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8b87d62f-4cd0-4813-a065-7749d104a1c1 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243" status: 404 len: 111 microversion: 2.1 time: 1.058566 Apr 11 18:19:34 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:32 2023] GET /compute/v2.1/servers/2fdbfe12-0376-480d-a63d-7db4a2ac2243 => generated 111 bytes in 1060 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=15 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:19:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" status: 204 len: 0 microversion: 2.1 time: 0.152517 Apr 11 18:19:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 185/569] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:19:37 2023] DELETE /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:37 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3b660a33-3603-4ddb-b632-d2dea336c12c tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" status: 200 len: 1671 microversion: 2.1 time: 0.255349 Apr 11 18:19:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 196/570] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:37 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "name": "network-vif-unplugged", "status": "completed", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Creating event network-vif-unplugged:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:19:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048884 Apr 11 18:19:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 190/571] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:38 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9a7deeb5-f9bb-4a94-aaac-ab90298b662f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1783 microversion: 2.20 time: 0.228837 Apr 11 18:19:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 186/572] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:19:38 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1783 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:39 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-091948ba-2be1-4bc6-9095-794dadcdc965 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1700 microversion: 2.1 time: 0.410549 Apr 11 18:19:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 197/573] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:38 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1700 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "name": "network-vif-deleted", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] Creating event network-vif-deleted:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:19:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041754 Apr 11 18:19:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 191/574] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7", "name": "network-vif-plugged", "status": "completed", "tag": "8110c1e3-0ed5-46e0-8f26-6c6d00460693"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:19:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Creating event network-vif-plugged:8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 on user Apr 11 18:19:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Apr 11 18:19:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 187/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=15 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:50 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6d3ee142-c269-4c96-b7ac-de16be495d3c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd" status: 200 len: 1497 microversion: 2.1 time: 0.165096 Apr 11 18:19:50 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 198/576] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:50 2023] GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] HTTP exception thrown: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Request method failure captured: Apr 11 18:19:50 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c HTTP/1.1 Apr 11 18:19:50 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:19:50 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:19:50 user devstack@n-api.service[72345]: Connection: close Apr 11 18:19:50 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:19:50 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:19:50 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:19:50 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:19:50 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaM4L8OkF4A3GPVIXi7en1U0Q2fE4ySQ5K3u8MOfXxD2PXiOC3Rx4I9K-pdF7m3cg83bPfG8TyJkQNyuiBfY9a0VgGevFNBvgRChqkbXpSMta7E6DIiR63KK4aEGSrWmhgQXQ4uvNDZmsPBtbhC79deS9IW6BTPhus4pkU6F0ymSuaM Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Project-Id: 6090bfb65d0c4afeb5ac38c45083799d Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestShelveInstance-839951281 Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6090bfb65d0c4afeb5ac38c45083799d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6090bfb65d0c4afeb5ac38c45083799d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6090bfb65d0c4afeb5ac38c45083799d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Tenant: tempest-TestShelveInstance-839951281 Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Tenant-Id: 6090bfb65d0c4afeb5ac38c45083799d Apr 11 18:19:50 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestShelveInstance-839951281 Apr 11 18:19:50 user devstack@n-api.service[72345]: X-User: tempest-TestShelveInstance-839951281-project-member Apr 11 18:19:50 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:19:50 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:19:50 user devstack@n-api.service[72345]: X-User-Id: 43dc7c5c888247029ff6adedbdb2e938 Apr 11 18:19:50 user devstack@n-api.service[72345]: X-User-Name: tempest-TestShelveInstance-839951281-project-member Apr 11 18:19:50 user devstack@n-api.service[72345]: method: > Apr 11 18:19:50 user devstack@n-api.service[72345]: exception: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. Apr 11 18:19:50 user devstack@n-api.service[72345]: action_args: {'id': '2fef8f1e-9300-4bd6-8958-4386541a9c0c'} Apr 11 18:19:50 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. Apr 11 18:19:50 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:19:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Returning 404 to user: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:19:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-06ca4c73-097c-461a-9f8c-070d36682582 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c" status: 404 len: 111 microversion: 2.1 time: 0.036057 Apr 11 18:19:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 192/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:50 2023] GET /compute/v2.1/servers/2fef8f1e-9300-4bd6-8958-4386541a9c0c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:19:51 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:51 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:19:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f2b5978f-0866-4626-a7fd-e9e1ce60c285 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Calling method '.version_select at 0x7fadb9667400>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f2b5978f-0866-4626-a7fd-e9e1ce60c285 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1371472427" status: 202 len: 0 microversion: 2.1 time: 0.033682 Apr 11 18:19:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 188/578] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 18:19:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1371472427 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:19:53 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:19:53 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ed3aa8a8-2673-454f-a9cb-85a567ecc394 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1728 microversion: 2.1 time: 0.149650 Apr 11 18:19:53 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 199/579] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:19:53 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:06 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d2157cd1-b378-462e-bd8f-f430ef5f45bc tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 200 len: 1539 microversion: 2.1 time: 0.348630 Apr 11 18:20:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 189/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:06 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 1539 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-abf45bc4-d263-4c59-8839-a916815b2cf9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1747 microversion: 2.1 time: 0.360565 Apr 11 18:20:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 193/581] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:06 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1747 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Creating event network-changed:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:20:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032063 Apr 11 18:20:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 200/582] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f35c4f-1fb8-4465-a94e-0119cf53bda2"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317680 Apr 11 18:20:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 190/583] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:20:08 2023] POST /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:16 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'services' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:20:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments/a0f35c4f-1fb8-4465-a94e-0119cf53bda2" status: 202 len: 0 microversion: 2.1 time: 0.292241 Apr 11 18:20:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:20:15 2023] DELETE /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments/a0f35c4f-1fb8-4465-a94e-0119cf53bda2 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-64a632b0-b452-4c8e-a363-96c3a28457e7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048757 Apr 11 18:20:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 201/585] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:20:16 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:17 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-720236868", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "403746c3-b913-4165-851f-a2bf3adaa8c6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:17 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:20:18 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='403746c3-b913-4165-851f-a2bf3adaa8c6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:20:18 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.729275 Apr 11 18:20:18 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 191/586] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:20:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:20:18 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7dc79308-4590-465c-bd6c-426c0a89b858 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:18 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7dc79308-4590-465c-bd6c-426c0a89b858 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:18 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-7dc79308-4590-465c-bd6c-426c0a89b858 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7dc79308-4590-465c-bd6c-426c0a89b858 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 200 len: 1051 microversion: 2.1 time: 0.077242 Apr 11 18:20:18 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 195/587] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:18 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 1051 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Creating event network-changed:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:20:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030312 Apr 11 18:20:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 202/588] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:22 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d7991420-3b3b-4d55-8acd-17eaaf5f7430 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091077 Apr 11 18:20:22 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 192/589] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:20:22 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-interface => generated 283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:23 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2addce-fd37-48c2-be0e-131ebef2ce29"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Creating event network-changed:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:20:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092375 Apr 11 18:20:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 196/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338546 Apr 11 18:20:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 203/591] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:20:23 2023] POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] HTTP exception thrown: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Request method failure captured: Apr 11 18:20:27 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 HTTP/1.1 Apr 11 18:20:27 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:20:27 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:20:27 user devstack@n-api.service[72343]: Connection: close Apr 11 18:20:27 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:20:27 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:20:27 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:20:27 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:20:27 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaNbZzkSfeD-l8DKAsPgFpsXCNfSuVT9S0ZLrHjNDhsdyB2oIFIftYNGkxdW6Vj0q0O0H2tfaGvEyORJgKtzqk6d8Dbtc3K0_ysDZX2TVxZzw4cQkjBnfA4yPtm75cJaEwpcc1k3bzqooG3T9yeqdMBTiRdRa5lU4z2MWaCW7BDAwMI Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Project-Id: ad8dd512b7424fbe996ecbd18d11471e Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad8dd512b7424fbe996ecbd18d11471e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Tenant-Id: ad8dd512b7424fbe996ecbd18d11471e Apr 11 18:20:27 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-298923704 Apr 11 18:20:27 user devstack@n-api.service[72343]: X-User: tempest-VolumesAdminNegativeTest-298923704-project-member Apr 11 18:20:27 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:20:27 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:20:27 user devstack@n-api.service[72343]: X-User-Id: d20726e00e3743168e32eafe43318e20 Apr 11 18:20:27 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesAdminNegativeTest-298923704-project-member Apr 11 18:20:27 user devstack@n-api.service[72343]: method: > Apr 11 18:20:27 user devstack@n-api.service[72343]: exception: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. Apr 11 18:20:27 user devstack@n-api.service[72343]: action_args: {'id': 'db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7'} Apr 11 18:20:27 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. Apr 11 18:20:27 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:20:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Returning 404 to user: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:20:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-84b5eaed-a9e9-470d-b758-d61da01649e7 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" status: 404 len: 111 microversion: 2.1 time: 0.029729 Apr 11 18:20:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 193/592] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:27 2023] GET /compute/v2.1/servers/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:20:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-76725b61-0db0-4230-8f13-d5ab01274289 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Calling method '.version_select at 0x7fadb967bc70>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-76725b61-0db0-4230-8f13-d5ab01274289 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581234075" status: 202 len: 0 microversion: 2.1 time: 0.023176 Apr 11 18:20:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 197/593] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:20:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581234075 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:30 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:20:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/action" status: 200 len: 32 microversion: 2.1 time: 0.193232 Apr 11 18:20:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 204/594] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:20:30 2023] POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:30 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e03b92f7-e1ce-4c15-96f1-7f3794b89b4c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1723 microversion: 2.1 time: 0.253388 Apr 11 18:20:30 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 194/595] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:30 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:31 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-unplugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Creating event network-vif-unplugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:20:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038082 Apr 11 18:20:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 198/596] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "name": "network-vif-plugged", "status": "completed", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Creating event network-vif-plugged:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:20:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108135 Apr 11 18:20:32 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 205/597] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:33 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:20:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Apr 11 18:20:33 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 195/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:34 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "name": "network-vif-plugged", "status": "completed", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:35 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Creating event network-vif-plugged:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:20:35 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044821 Apr 11 18:20:35 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 199/599] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:35 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}, {"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:35 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:20:35 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:20:35 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041985 Apr 11 18:20:35 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 206/600] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:38 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-0bd214a5-cabf-4d79-ab09-57e5f7b8ee7d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments/cec3ad28-d4ef-47b1-8fb0-4e979af79136" status: 200 len: 194 microversion: 2.20 time: 0.299922 Apr 11 18:20:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 196/601] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 18:20:38 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments/cec3ad28-d4ef-47b1-8fb0-4e979af79136 => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:38 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'services' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:20:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments/cec3ad28-d4ef-47b1-8fb0-4e979af79136" status: 202 len: 0 microversion: 2.20 time: 0.197011 Apr 11 18:20:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 200/602] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 18:20:38 2023] DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments/cec3ad28-d4ef-47b1-8fb0-4e979af79136 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=15 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:39 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-1fbcddb4-2385-4ef5-8005-b33e4998f95f tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077388 Apr 11 18:20:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 207/603] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 18:20:39 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:39 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'services' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:20:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments/7fcd6aab-4190-481d-bea1-4aff73c18083" status: 202 len: 0 microversion: 2.1 time: 0.383277 Apr 11 18:20:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 197/604] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:20:39 2023] DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments/7fcd6aab-4190-481d-bea1-4aff73c18083 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:20:42 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:42 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Going to try to stop instance {{(pid=72345) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 18:20:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action" status: 202 len: 0 microversion: 2.1 time: 0.137865 Apr 11 18:20:42 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 201/605] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:20:42 2023] POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:42 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3b65bb8a-91e7-45ea-b3f4-bdb78e025798 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1664 microversion: 2.1 time: 0.282169 Apr 11 18:20:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 208/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:42 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1664 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-unplugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Creating event network-vif-unplugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:20:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113470 Apr 11 18:20:42 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 198/607] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:44 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-690899682", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "c65d6737-91d9-40cd-a03c-f8049dc621fe"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:44 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] validate_networks() for [('c65d6737-91d9-40cd-a03c-f8049dc621fe', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:20:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:20:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040829 Apr 11 18:20:44 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 209/608] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for user fde784625fda4447afc0b8e9bd0983a3 and project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:20:45 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:20:45 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.615358 Apr 11 18:20:45 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 202/609] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:20:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:20:45 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:45 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:45 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:45 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:45 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-68108dc4-d987-4d56-9477-94e0799f36d5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 200 len: 1394 microversion: 2.87 time: 0.101198 Apr 11 18:20:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 199/610] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:20:45 2023] GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 1394 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:20:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Creating event network-changed:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:20:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039190 Apr 11 18:20:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 210/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5c165e2-cf22-4292-a456-43dde9aacda5", "device": "/dev/vdb"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "name": "network-vif-plugged", "status": "completed", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Creating event network-vif-plugged:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:20:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037756 Apr 11 18:20:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 200/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:51 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388808 Apr 11 18:20:51 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 203/613] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:20:50 2023] POST /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "name": "network-vif-plugged", "status": "completed", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Creating event network-vif-plugged:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:20:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Apr 11 18:20:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 211/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action" status: 202 len: 0 microversion: 2.1 time: 0.178709 Apr 11 18:20:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 201/615] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:20:54 2023] POST /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:54 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:20:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d726a20d-ec81-446a-a306-bcd4b928126d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1727 microversion: 2.1 time: 0.257584 Apr 11 18:20:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 204/616] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:20:54 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1727 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:20:55 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-unplugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Creating event network-vif-unplugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:20:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72344) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:20:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036074 Apr 11 18:20:55 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 212/617] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:20:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:20:57 user devstack@n-api.service[72343]: DEBUG nova.compute.api [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:20:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044175 Apr 11 18:20:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 202/618] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1860f05c-a3d1-4c63-8315-fd31ccac530c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050239 Apr 11 18:21:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 205/619] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:21:06 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=11 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=21 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-829198473"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Creating event network-changed:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:21:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Apr 11 18:21:06 user devstack@n-api.service[72344]: INFO nova.network.security_group_api [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Removing security group 0b5d3c4e-1b54-4ced-875d-37aab51525a9 from port 23c3497e-9e98-496c-b81b-3ce400105b1b Apr 11 18:21:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 206/620] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:21:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 204 len: 0 microversion: 2.1 time: 0.134226 Apr 11 18:21:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 203/621] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:21:06 2023] DELETE /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:07 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-aec4b49a-34ac-408e-ba54-c6973b994b69 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 200 len: 1664 microversion: 2.1 time: 0.395868 Apr 11 18:21:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:07 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 1664 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:07 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-01beee92-4e06-4840-9bda-017382726780 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action" status: 202 len: 0 microversion: 2.1 time: 0.971170 Apr 11 18:21:07 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 213/623] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:21:06 2023] POST /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/action => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:21:07 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Creating event network-changed:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:21:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039424 Apr 11 18:21:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 204/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:21:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72345) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:21:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059465 Apr 11 18:21:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "name": "network-vif-unplugged", "status": "completed", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}, {"server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "name": "network-vif-plugged", "status": "completed", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:08 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Creating event network-vif-unplugged:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Creating event network-vif-plugged:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036273 Apr 11 18:21:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 205/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e76b486f-6ecd-4039-a588-09e413b134c6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 200 len: 1378 microversion: 2.1 time: 1.102641 Apr 11 18:21:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 214/627] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:08 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 1378 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b91dda-27c6-4bcd-99ec-c818c5c93373", "name": "network-vif-deleted", "tag": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed"}, {"name": "network-changed", "server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Creating event network-vif-deleted:4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 on user Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Creating event network-changed:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:21:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044234 Apr 11 18:21:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 206/628] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:09 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'services' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'services' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:21:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/os-volume_attachments/a5c165e2-cf22-4292-a456-43dde9aacda5" status: 202 len: 0 microversion: 2.1 time: 0.197123 Apr 11 18:21:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 215/629] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:21:09 2023] DELETE /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/os-volume_attachments/a5c165e2-cf22-4292-a456-43dde9aacda5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments/a3861b91-6351-4328-8e27-bbffbd356684" status: 202 len: 0 microversion: 2.1 time: 0.328918 Apr 11 18:21:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 209/630] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:21:09 2023] DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments/a3861b91-6351-4328-8e27-bbffbd356684 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72344) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:21:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045730 Apr 11 18:21:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 216/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd" status: 204 len: 0 microversion: 2.1 time: 0.146645 Apr 11 18:21:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 207/632] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:21:10 2023] DELETE /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8ab1ebf0-b044-46ea-836f-6fa71e545280 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083315 Apr 11 18:21:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 210/633] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:21:10 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:10 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-58ef2c55-7fba-41fa-af11-8666b48f5a45 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd" status: 200 len: 1549 microversion: 2.1 time: 0.318874 Apr 11 18:21:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 217/634] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:10 2023] GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd => generated 1549 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:12 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "name": "network-vif-unplugged", "status": "completed", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Creating event network-vif-unplugged:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:21:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032557 Apr 11 18:21:12 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 208/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "name": "network-vif-deleted", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] Creating event network-vif-deleted:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:21:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040864 Apr 11 18:21:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 211/636] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f8fb2-8d06-4766-921f-a3ceb83f4bbd", "name": "network-vif-plugged", "status": "completed", "tag": "acc2e042-39c9-42c0-9fbe-405412bba1af"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Creating event network-vif-plugged:acc2e042-39c9-42c0-9fbe-405412bba1af for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd on user Apr 11 18:21:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028241 Apr 11 18:21:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 218/637] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:21 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-916cc040-b0df-4a02-b984-aef30c723e6c tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1703 microversion: 2.1 time: 0.415874 Apr 11 18:21:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 209/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:20 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1703 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=14 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a14b01c8-04f8-4ae7-aa8b-746c1593c9ce tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048712 Apr 11 18:21:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 212/639] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 18:21:29 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:21:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 204 len: 0 microversion: 2.20 time: 0.117503 Apr 11 18:21:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 219/640] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:21:29 2023] DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:29 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bfe1a56c-16a2-4de2-9cfb-fb86f6acfd22 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 200 len: 1711 microversion: 2.20 time: 0.201135 Apr 11 18:21:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 210/641] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:21:29 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 1711 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-unplugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Creating event network-vif-unplugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:21:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030279 Apr 11 18:21:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 213/642] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-deleted", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] Creating event network-vif-deleted:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:21:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033620 Apr 11 18:21:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 220/643] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582e004b-a2f3-4397-9ccb-d23f5724ebe1", "name": "network-vif-plugged", "status": "completed", "tag": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:21:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Creating event network-vif-plugged:f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 on user Apr 11 18:21:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027451 Apr 11 18:21:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 211/644] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:32 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7298014b-65a5-4114-8ade-5ff706e6072a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1641 microversion: 2.1 time: 0.147346 Apr 11 18:21:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 214/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:32 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1641 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:35 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:35 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-67f8f0d4-be75-4bc1-9e1e-c8fa613b177d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 200 len: 1688 microversion: 2.87 time: 0.192086 Apr 11 18:21:35 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 221/646] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:21:35 2023] GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:44 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:21:44 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6716a31c-15f2-4665-9caa-b09b3309407a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.181093 Apr 11 18:21:44 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 212/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:44 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=14 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:21:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] HTTP exception thrown: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Request method failure captured: Apr 11 18:21:57 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 HTTP/1.1 Apr 11 18:21:57 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:21:57 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:21:57 user devstack@n-api.service[72345]: Connection: close Apr 11 18:21:57 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:21:57 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:21:57 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:21:57 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:21:57 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOm-TCGF9Imyf3JL0f25lkQURtzAkKi_1MsucmHQa2l8Bncj-BRSN5hOBnc_G3IGjWwcUAuA8cSqNkDBkHbWB3t7ahD-NlGGkCX1sueHiBrGzG3oo97kHO0jNEjzI2oURBQoUQ8Y3theyP-KUohyLJvGQB4IcChuqApoQyaXS39S-Q Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Project-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestStampPattern-1680133886 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86e02898b1bc4378822244d9522ff042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Tenant: tempest-TestStampPattern-1680133886 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Tenant-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestStampPattern-1680133886 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-User: tempest-TestStampPattern-1680133886-project-member Apr 11 18:21:57 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:21:57 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:21:57 user devstack@n-api.service[72345]: X-User-Id: c44e6b75d86f4ff0b6f93123ce15ccc0 Apr 11 18:21:57 user devstack@n-api.service[72345]: X-User-Name: tempest-TestStampPattern-1680133886-project-member Apr 11 18:21:57 user devstack@n-api.service[72345]: method: > Apr 11 18:21:57 user devstack@n-api.service[72345]: exception: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. Apr 11 18:21:57 user devstack@n-api.service[72345]: action_args: {'id': 'e7b91dda-27c6-4bcd-99ec-c818c5c93373'} Apr 11 18:21:57 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. Apr 11 18:21:57 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:21:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Returning 404 to user: Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:21:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-99ebbde9-beca-4735-a2b4-3916376d628c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373" status: 404 len: 111 microversion: 2.1 time: 0.037853 Apr 11 18:21:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 215/648] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:21:57 2023] GET /compute/v2.1/servers/e7b91dda-27c6-4bcd-99ec-c818c5c93373 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] HTTP exception thrown: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 is not attached to volume 30162a26-a276-44ab-8f84-434ae2dde3e9 Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Request method failure captured: Apr 11 18:22:00 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments/30162a26-a276-44ab-8f84-434ae2dde3e9 HTTP/1.1 Apr 11 18:22:00 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:22:00 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:22:00 user devstack@n-api.service[72344]: Connection: close Apr 11 18:22:00 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:22:00 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:22:00 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:22:00 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:22:00 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOm-TCGF9Imyf3JL0f25lkQURtzAkKi_1MsucmHQa2l8Bncj-BRSN5hOBnc_G3IGjWwcUAuA8cSqNkDBkHbWB3t7ahD-NlGGkCX1sueHiBrGzG3oo97kHO0jNEjzI2oURBQoUQ8Y3theyP-KUohyLJvGQB4IcChuqApoQyaXS39S-Q Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestStampPattern-1680133886 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86e02898b1bc4378822244d9522ff042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant: tempest-TestStampPattern-1680133886 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestStampPattern-1680133886 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User: tempest-TestStampPattern-1680133886-project-member Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Id: c44e6b75d86f4ff0b6f93123ce15ccc0 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Name: tempest-TestStampPattern-1680133886-project-member Apr 11 18:22:00 user devstack@n-api.service[72344]: method: > Apr 11 18:22:00 user devstack@n-api.service[72344]: exception: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 is not attached to volume 30162a26-a276-44ab-8f84-434ae2dde3e9 Apr 11 18:22:00 user devstack@n-api.service[72344]: action_args: {'server_id': '91bf5195-b2bc-48ca-9632-5ae616090fd2', 'id': '30162a26-a276-44ab-8f84-434ae2dde3e9'} Apr 11 18:22:00 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 30162a26-a276-44ab-8f84-434ae2dde3e9. Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 is not attached to volume 30162a26-a276-44ab-8f84-434ae2dde3e9 Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 is not attached to volume 30162a26-a276-44ab-8f84-434ae2dde3e9 Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Returning 404 to user: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 is not attached to volume 30162a26-a276-44ab-8f84-434ae2dde3e9 {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-414b0f9a-68fc-4393-b51f-3b44f463f3b9 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments/30162a26-a276-44ab-8f84-434ae2dde3e9" status: 404 len: 154 microversion: 2.1 time: 0.111396 Apr 11 18:22:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 222/649] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:22:00 2023] DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2/os-volume_attachments/30162a26-a276-44ab-8f84-434ae2dde3e9 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e1b5a816-5f25-4e24-ad1f-7f41a7cb0c0b tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048165 Apr 11 18:22:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 213/650] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:22:00 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HTTP exception thrown: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d is not attached to volume a3861b91-6351-4328-8e27-bbffbd356684 Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Request method failure captured: Apr 11 18:22:00 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments/a3861b91-6351-4328-8e27-bbffbd356684 HTTP/1.1 Apr 11 18:22:00 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:22:00 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:22:00 user devstack@n-api.service[72345]: Connection: close Apr 11 18:22:00 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:22:00 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:22:00 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:22:00 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:22:00 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaK_tCq0GvSk-CGBQ-2VHdeNLqtzXCBP77t0Bz7GhYB4hpjmPfMQggQalZBb7GOlOAxn9jDU9Y0CKtreMg0zJ5ogd8Whb3zedvIPC1iXZquTbV908Bj7et0TJmgEoqSoo78UMPcT8omRUGl9YX1lCTw8wetWWpLmEGbxe1hFGK_5Yc8 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Project-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Tenant: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Tenant-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-User: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:22:00 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72345]: X-User-Id: dd1c4ded6c544d6eb16e9086c6259750 Apr 11 18:22:00 user devstack@n-api.service[72345]: X-User-Name: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:22:00 user devstack@n-api.service[72345]: method: > Apr 11 18:22:00 user devstack@n-api.service[72345]: exception: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d is not attached to volume a3861b91-6351-4328-8e27-bbffbd356684 Apr 11 18:22:00 user devstack@n-api.service[72345]: action_args: {'server_id': '7296c02e-f468-45b9-b037-e6cd240dd27d', 'id': 'a3861b91-6351-4328-8e27-bbffbd356684'} Apr 11 18:22:00 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a3861b91-6351-4328-8e27-bbffbd356684. Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d is not attached to volume a3861b91-6351-4328-8e27-bbffbd356684 Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d is not attached to volume a3861b91-6351-4328-8e27-bbffbd356684 Apr 11 18:22:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Returning 404 to user: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d is not attached to volume a3861b91-6351-4328-8e27-bbffbd356684 {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f4927e41-057c-4e05-ba9d-f73a56279b5a tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments/a3861b91-6351-4328-8e27-bbffbd356684" status: 404 len: 154 microversion: 2.1 time: 0.119272 Apr 11 18:22:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 216/651] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:22:00 2023] DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d/os-volume_attachments/a3861b91-6351-4328-8e27-bbffbd356684 => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] HTTP exception thrown: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Request method failure captured: Apr 11 18:22:00 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd HTTP/1.1 Apr 11 18:22:00 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:22:00 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:22:00 user devstack@n-api.service[72344]: Connection: close Apr 11 18:22:00 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:22:00 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:22:00 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:22:00 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:22:00 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaSQuehIzX5QWeMjAMLuYA7bT24Pqf211dZblI5HfaV1JxrEDejVMAcV8oy1ZlMUpBo92zQA1hewsmmSNodvYB718eol5WJPlGPLVparYfyr4Wd57rV7jYujU-He58Bq4uE7jGPkQF8FncL9TioC6q6QirudqUzJojAx1EK2gdjzfss Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Id: fde6ebc41bed44f1a04e23e62cd9ac0d Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Project-Name: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant-Id: fde6ebc41bed44f1a04e23e62cd9ac0d Apr 11 18:22:00 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User: tempest-VolumesSnapshotTestJSON-251988417-project-member Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Id: 5fdf10ea561448f689cdd2d052080168 Apr 11 18:22:00 user devstack@n-api.service[72344]: X-User-Name: tempest-VolumesSnapshotTestJSON-251988417-project-member Apr 11 18:22:00 user devstack@n-api.service[72344]: method: > Apr 11 18:22:00 user devstack@n-api.service[72344]: exception: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. Apr 11 18:22:00 user devstack@n-api.service[72344]: action_args: {'id': '671f8fb2-8d06-4766-921f-a3ceb83f4bbd'} Apr 11 18:22:00 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. Apr 11 18:22:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Returning 404 to user: Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-45c48081-3103-43e6-be2d-0b0f2c7cfd73 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd" status: 404 len: 111 microversion: 2.1 time: 0.034918 Apr 11 18:22:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 223/652] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:00 2023] GET /compute/v2.1/servers/671f8fb2-8d06-4766-921f-a3ceb83f4bbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Creating event network-changed:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:22:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033323 Apr 11 18:22:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 217/653] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:22:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 204 len: 0 microversion: 2.1 time: 0.163106 Apr 11 18:22:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 214/654] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:22:00 2023] DELETE /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:22:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:01 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a8f012f6-ebd0-4cda-a826-eb04d3af390c tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 200 len: 1664 microversion: 2.1 time: 0.314155 Apr 11 18:22:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 224/655] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:00 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 1664 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Creating event network-vif-unplugged:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:22:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037641 Apr 11 18:22:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 218/656] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "name": "network-vif-deleted", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] Creating event network-vif-deleted:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:22:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Apr 11 18:22:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 215/657] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:02 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:22:02 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 204 len: 0 microversion: 2.1 time: 0.169426 Apr 11 18:22:02 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 225/658] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:22:02 2023] DELETE /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:03 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-391e7ec9-1dda-4750-8e98-f3dc5e6c1803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 200 len: 1542 microversion: 2.1 time: 0.160395 Apr 11 18:22:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:02 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 1542 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-unplugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Creating event network-vif-unplugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034119 Apr 11 18:22:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 216/660] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bf5195-b2bc-48ca-9632-5ae616090fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ca931e62-5efe-439f-831c-1792c67eae7f"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Creating event network-vif-plugged:ca931e62-5efe-439f-831c-1792c67eae7f for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 on user Apr 11 18:22:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037841 Apr 11 18:22:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 226/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-deleted", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] Creating event network-vif-deleted:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039131 Apr 11 18:22:05 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 220/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}, {"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}, {"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}, {"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-unplugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}, {"server_uuid": "7296c02e-f468-45b9-b037-e6cd240dd27d", "name": "network-vif-plugged", "status": "completed", "tag": "23c3497e-9e98-496c-b81b-3ce400105b1b"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Creating event network-vif-unplugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Creating event network-vif-plugged:23c3497e-9e98-496c-b81b-3ce400105b1b for instance 7296c02e-f468-45b9-b037-e6cd240dd27d on user Apr 11 18:22:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032692 Apr 11 18:22:05 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 217/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1601205193", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "63428a67-aad6-41c0-8022-1c7dbad79e7b"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:05 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] validate_networks() for [('63428a67-aad6-41c0-8022-1c7dbad79e7b', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting quotas for project fde6ebc41bed44f1a04e23e62cd9ac0d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting quotas for user 5fdf10ea561448f689cdd2d052080168 and project fde6ebc41bed44f1a04e23e62cd9ac0d. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:22:06 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:22:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.566903 Apr 11 18:22:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 227/664] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:22:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:22:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-fd2af1b4-1223-4c92-a2f4-da4f8ed03135 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-fd2af1b4-1223-4c92-a2f4-da4f8ed03135 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-fd2af1b4-1223-4c92-a2f4-da4f8ed03135 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-fd2af1b4-1223-4c92-a2f4-da4f8ed03135 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048" status: 200 len: 1213 microversion: 2.1 time: 0.073542 Apr 11 18:22:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 221/665] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:06 2023] GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Creating event network-changed:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:22:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029234 Apr 11 18:22:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 218/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2cde289d-6f51-4e79-a855-27df1c8ca950 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 200 len: 1378 microversion: 2.1 time: 0.227838 Apr 11 18:22:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 228/667] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:09 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 1378 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:09 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-5e9f183d-e3d3-4a0b-b2a3-91f249b6668d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 200 len: 1378 microversion: 2.1 time: 0.230958 Apr 11 18:22:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 222/668] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:09 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 1378 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:22:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 204 len: 0 microversion: 2.1 time: 0.114387 Apr 11 18:22:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 219/669] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:22:10 2023] DELETE /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:10 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3da2d947-fbfb-4274-bb0d-88cb15a81452 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 200 len: 1384 microversion: 2.1 time: 0.175505 Apr 11 18:22:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 229/670] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:10 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 1384 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "name": "network-vif-unplugged", "status": "completed", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Creating event network-vif-unplugged:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:22:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046102 Apr 11 18:22:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 223/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "name": "network-vif-plugged", "status": "completed", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Creating event network-vif-plugged:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:22:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Apr 11 18:22:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 220/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "name": "network-vif-deleted", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] Creating event network-vif-deleted:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:22:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Apr 11 18:22:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 230/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd52279-f440-48cb-9c97-8133c7322482", "name": "network-vif-plugged", "status": "completed", "tag": "8db65a44-6cb3-4c5e-b180-49709126b545"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Creating event network-vif-plugged:8db65a44-6cb3-4c5e-b180-49709126b545 for instance bfd52279-f440-48cb-9c97-8133c7322482 on user Apr 11 18:22:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Apr 11 18:22:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 224/674] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "name": "network-vif-plugged", "status": "completed", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Creating event network-vif-plugged:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:22:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031531 Apr 11 18:22:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 221/675] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:22:19 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 HTTP/1.1 Apr 11 18:22:19 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:22:19 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:22:19 user devstack@n-api.service[72344]: Connection: close Apr 11 18:22:19 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:22:19 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:22:19 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:22:19 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:22:19 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:22:19 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:22:19 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:22:19 user devstack@n-api.service[72344]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:22:19 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:22:19 user devstack@n-api.service[72344]: method: > Apr 11 18:22:19 user devstack@n-api.service[72344]: exception: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:22:19 user devstack@n-api.service[72344]: action_args: {'id': '582e004b-a2f3-4397-9ccb-d23f5724ebe1'} Apr 11 18:22:19 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:22:19 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d7de0b93-7229-4db4-a850-2bb1e6c57805 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 404 len: 111 microversion: 2.20 time: 0.034407 Apr 11 18:22:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 231/676] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:22:19 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:22:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-fb0c8446-ac72-4798-a7b5-ccf83053193b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '.version_select at 0x7fadb95b7640>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:19 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-fb0c8446-ac72-4798-a7b5-ccf83053193b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504297625" status: 204 len: 0 microversion: 2.20 time: 0.024081 Apr 11 18:22:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 225/677] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 18:22:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504297625 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:22:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2439aabd-9563-441b-a363-762686800759 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: .version_select at 0x7fadb9485750>, body: {"keypair": {"name": "tempest-keypair-1067458808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4UT1jM+S2X9MyxQqF+Oy/72JleNBxRkmuHwrvJGSFpmjQkv23wckhLJZtjOdqaJJ0Z7NI49IR6xFA4+Vc5wRw9Eh60mBoafHGjPt+olG1clsJEASk4rQXvE+RJNyQ5AQ=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-2439aabd-9563-441b-a363-762686800759 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:22:20 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-2439aabd-9563-441b-a363-762686800759 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for user b724859b7dcd4fd29f17bbf991e9f6d4 and project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:22:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2439aabd-9563-441b-a363-762686800759 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050321 Apr 11 18:22:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 222/678] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 18:22:20 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HTTP exception thrown: Cannot 'detach_volume' instance c5a2e113-75f7-47ac-bdf9-458793a62061 while it is in vm_state rescued Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Request method failure captured: Apr 11 18:22:21 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments/ab2addce-fd37-48c2-be0e-131ebef2ce29 HTTP/1.1 Apr 11 18:22:21 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:22:21 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:22:21 user devstack@n-api.service[72344]: Connection: close Apr 11 18:22:21 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:22:21 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:22:21 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:22:21 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:22:21 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ3xoWpA6L6sJDUdOd8AExbBGkGdm0qz8n435SJOLLg4ULs4B7aG2c1bJHYh0qnXRM-k9IQThZm2fiVkH9nH5TCuCTtC9SIEpEvjHnYebgTEEAF0nZuw7F41zUga4NdnvnoJ4ZbX_WODBfNPtfgvtFdKqoTscgLbnT3iQhM1z9hXcU Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Project-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Tenant-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:22:21 user devstack@n-api.service[72344]: X-User: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:22:21 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:22:21 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:22:21 user devstack@n-api.service[72344]: X-User-Id: 908e0b5a1ce14f5cb636eda79ac77f7b Apr 11 18:22:21 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:22:21 user devstack@n-api.service[72344]: method: > Apr 11 18:22:21 user devstack@n-api.service[72344]: exception: Cannot 'detach_volume' instance c5a2e113-75f7-47ac-bdf9-458793a62061 while it is in vm_state rescued Apr 11 18:22:21 user devstack@n-api.service[72344]: action_args: {'server_id': 'c5a2e113-75f7-47ac-bdf9-458793a62061', 'id': 'ab2addce-fd37-48c2-be0e-131ebef2ce29'} Apr 11 18:22:21 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c5a2e113-75f7-47ac-bdf9-458793a62061 while it is in vm_state rescued Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c5a2e113-75f7-47ac-bdf9-458793a62061 while it is in vm_state rescued Apr 11 18:22:21 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Returning 409 to user: Cannot 'detach_volume' instance c5a2e113-75f7-47ac-bdf9-458793a62061 while it is in vm_state rescued {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d496ad90-2e1a-4098-bc20-0d9ff49d9a58 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments/ab2addce-fd37-48c2-be0e-131ebef2ce29" status: 409 len: 152 microversion: 2.1 time: 0.094929 Apr 11 18:22:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 232/679] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:22:21 2023] DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments/ab2addce-fd37-48c2-be0e-131ebef2ce29 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/action" status: 202 len: 0 microversion: 2.1 time: 0.106828 Apr 11 18:22:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 226/680] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:22:21 2023] POST /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1891122104", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a"}], "security_groups": [{"name": "tempest-securitygroup--2042856950"}], "key_name": "tempest-keypair-1067458808", "user_data": "}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:21 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f2b2b340-72d8-4539-b569-6810a2b21ead tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1711 microversion: 2.1 time: 0.165277 Apr 11 18:22:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 223/681] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:21 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:22:21 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] validate_networks() for [('bde85ee5-a5c4-4773-b4dd-b58d44a7f92a', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting quotas for user b724859b7dcd4fd29f17bbf991e9f6d4 and project 0ed92c60cf9644b5ba5cefd2e92df3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:22:22 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:22:22 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.134084 Apr 11 18:22:22 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 233/682] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:22:21 2023] POST /compute/v2.1/servers => generated 400 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:22:22 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:22 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:22 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:22 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:22 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1366f93b-5f44-4bb9-a07c-8b32ddd62e37 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1276 microversion: 2.20 time: 0.090469 Apr 11 18:22:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 227/683] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:22:22 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:22:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-unplugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Creating event network-vif-unplugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:22:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041839 Apr 11 18:22:23 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 224/684] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}, {"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:22:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:22:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032254 Apr 11 18:22:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 234/685] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Creating event network-changed:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:22:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039915 Apr 11 18:22:25 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 228/686] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:22:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Apr 11 18:22:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 225/687] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:22:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038183 Apr 11 18:22:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 235/688] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:22:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 Apr 11 18:22:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 229/689] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Going to try to start instance {{(pid=72343) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 18:22:33 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action" status: 202 len: 0 microversion: 2.1 time: 0.139873 Apr 11 18:22:33 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 226/690] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:22:33 2023] POST /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:33 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-19ae4524-807b-4234-8ad9-57b78e84e525 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1650 microversion: 2.1 time: 0.236614 Apr 11 18:22:33 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 236/691] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:33 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1650 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1280588665"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:36 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:22:36 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038889 Apr 11 18:22:36 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 227/692] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:36 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d/action" status: 202 len: 52 microversion: 2.87 time: 0.987164 Apr 11 18:22:36 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 230/693] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:22:35 2023] POST /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d/action => generated 52 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:22:38 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:22:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:22:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Apr 11 18:22:38 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 237/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:42 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-74e9a210-d38c-431c-bbc8-cb114149da27 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 200 len: 1688 microversion: 2.87 time: 0.207203 Apr 11 18:22:42 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 228/695] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:22:42 2023] GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:44 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:44 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-39b53e3f-1aeb-495d-96aa-d857d0327570 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.164236 Apr 11 18:22:44 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:44 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:45 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-bc468c96-56ca-4735-928a-0f1e6d178c81 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1720 microversion: 2.1 time: 0.335785 Apr 11 18:22:45 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 238/697] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:44 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] HTTP exception thrown: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Request method failure captured: Apr 11 18:22:51 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 HTTP/1.1 Apr 11 18:22:51 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:22:51 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:22:51 user devstack@n-api.service[72343]: Connection: close Apr 11 18:22:51 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:22:51 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:22:51 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:22:51 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:22:51 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaOm-TCGF9Imyf3JL0f25lkQURtzAkKi_1MsucmHQa2l8Bncj-BRSN5hOBnc_G3IGjWwcUAuA8cSqNkDBkHbWB3t7ahD-NlGGkCX1sueHiBrGzG3oo97kHO0jNEjzI2oURBQoUQ8Y3theyP-KUohyLJvGQB4IcChuqApoQyaXS39S-Q Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Project-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestStampPattern-1680133886 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86e02898b1bc4378822244d9522ff042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86e02898b1bc4378822244d9522ff042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Tenant: tempest-TestStampPattern-1680133886 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Tenant-Id: 86e02898b1bc4378822244d9522ff042 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestStampPattern-1680133886 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-User: tempest-TestStampPattern-1680133886-project-member Apr 11 18:22:51 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:22:51 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:22:51 user devstack@n-api.service[72343]: X-User-Id: c44e6b75d86f4ff0b6f93123ce15ccc0 Apr 11 18:22:51 user devstack@n-api.service[72343]: X-User-Name: tempest-TestStampPattern-1680133886-project-member Apr 11 18:22:51 user devstack@n-api.service[72343]: method: > Apr 11 18:22:51 user devstack@n-api.service[72343]: exception: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. Apr 11 18:22:51 user devstack@n-api.service[72343]: action_args: {'id': '91bf5195-b2bc-48ca-9632-5ae616090fd2'} Apr 11 18:22:51 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. Apr 11 18:22:51 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:22:51 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Returning 404 to user: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-82de9aa5-3415-4335-a3e8-0e5e479a97b6 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2" status: 404 len: 111 microversion: 2.1 time: 0.029644 Apr 11 18:22:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 229/698] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:51 2023] GET /compute/v2.1/servers/91bf5195-b2bc-48ca-9632-5ae616090fd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c87d7f0d-9489-4098-af4a-b2dea5bcd683 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Calling method '.version_select at 0x7fadb95b7d90>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c87d7f0d-9489-4098-af4a-b2dea5bcd683 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1363613236" status: 202 len: 0 microversion: 2.1 time: 0.030996 Apr 11 18:22:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:22:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1363613236 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:53 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HTTP exception thrown: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Request method failure captured: Apr 11 18:22:53 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d HTTP/1.1 Apr 11 18:22:53 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:22:53 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:22:53 user devstack@n-api.service[72344]: Connection: close Apr 11 18:22:53 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:22:53 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:22:53 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:22:53 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:22:53 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaK_tCq0GvSk-CGBQ-2VHdeNLqtzXCBP77t0Bz7GhYB4hpjmPfMQggQalZBb7GOlOAxn9jDU9Y0CKtreMg0zJ5ogd8Whb3zedvIPC1iXZquTbV908Bj7et0TJmgEoqSoo78UMPcT8omRUGl9YX1lCTw8wetWWpLmEGbxe1hFGK_5Yc8 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Project-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a70e133c013140e1a17804737f4e3ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Tenant: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Tenant-Id: a70e133c013140e1a17804737f4e3ef7 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestMinimumBasicScenario-492134328 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-User: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:22:53 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:22:53 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:22:53 user devstack@n-api.service[72344]: X-User-Id: dd1c4ded6c544d6eb16e9086c6259750 Apr 11 18:22:53 user devstack@n-api.service[72344]: X-User-Name: tempest-TestMinimumBasicScenario-492134328-project-member Apr 11 18:22:53 user devstack@n-api.service[72344]: method: > Apr 11 18:22:53 user devstack@n-api.service[72344]: exception: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. Apr 11 18:22:53 user devstack@n-api.service[72344]: action_args: {'id': '7296c02e-f468-45b9-b037-e6cd240dd27d'} Apr 11 18:22:53 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. Apr 11 18:22:53 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:22:53 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Returning 404 to user: Instance 7296c02e-f468-45b9-b037-e6cd240dd27d could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:22:53 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6ec2f20a-f949-487c-85b0-fd4a1f489e1e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d" status: 404 len: 111 microversion: 2.1 time: 0.034870 Apr 11 18:22:53 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 239/700] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:53 2023] GET /compute/v2.1/servers/7296c02e-f468-45b9-b037-e6cd240dd27d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:22:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-aa62b14b-d0f8-43ab-a5f0-546cd1a28370 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Calling method '.version_select at 0x7fadb95ae5f0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-aa62b14b-d0f8-43ab-a5f0-546cd1a28370 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654518614" status: 202 len: 0 microversion: 2.1 time: 0.022143 Apr 11 18:22:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 230/701] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 11 18:22:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654518614 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:22:56 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:22:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b3dea4c4-2598-41d2-acef-edbfa45ca61c tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048" status: 200 len: 1496 microversion: 2.1 time: 0.275972 Apr 11 18:22:56 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 233/702] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:22:56 2023] GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:23:00 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 HTTP/1.1 Apr 11 18:23:00 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:23:00 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:23:00 user devstack@n-api.service[72344]: Connection: close Apr 11 18:23:00 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:23:00 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:23:00 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:23:00 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:23:00 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72344]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72344]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:23:00 user devstack@n-api.service[72344]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72344]: method: > Apr 11 18:23:00 user devstack@n-api.service[72344]: exception: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72344]: action_args: {'id': 'bfd52279-f440-48cb-9c97-8133c7322482'} Apr 11 18:23:00 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:23:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-82231d81-5622-4074-a834-42b1c18eca56 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 404 len: 111 microversion: 2.1 time: 0.028947 Apr 11 18:23:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 240/703] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:00 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:23:00 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 HTTP/1.1 Apr 11 18:23:00 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:23:00 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:23:00 user devstack@n-api.service[72343]: Connection: close Apr 11 18:23:00 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:23:00 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:23:00 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:23:00 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:23:00 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72343]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72343]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:23:00 user devstack@n-api.service[72343]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72343]: method: > Apr 11 18:23:00 user devstack@n-api.service[72343]: exception: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72343]: action_args: {'id': 'bfd52279-f440-48cb-9c97-8133c7322482'} Apr 11 18:23:00 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:23:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5b000894-8f3f-455a-8071-e6c0c5582dc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 404 len: 111 microversion: 2.1 time: 0.031623 Apr 11 18:23:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 231/704] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:23:00 2023] DELETE /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:23:00 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 HTTP/1.1 Apr 11 18:23:00 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:23:00 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:23:00 user devstack@n-api.service[72345]: Connection: close Apr 11 18:23:00 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:23:00 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:23:00 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:23:00 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:23:00 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:23:00 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:23:00 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:23:00 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:23:00 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:23:00 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:23:00 user devstack@n-api.service[72345]: method: > Apr 11 18:23:00 user devstack@n-api.service[72345]: exception: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72345]: action_args: {'id': 'bfd52279-f440-48cb-9c97-8133c7322482'} Apr 11 18:23:00 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. Apr 11 18:23:00 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:23:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:23:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-412d3a47-1275-4c05-a946-79d2988b1942 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482" status: 404 len: 111 microversion: 2.1 time: 0.033937 Apr 11 18:23:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:00 2023] GET /compute/v2.1/servers/bfd52279-f440-48cb-9c97-8133c7322482 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2036153281", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "94331799-c0ed-4258-962d-d21d01e8de14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=10 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=18 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:23:04 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94331799-c0ed-4258-962d-d21d01e8de14',volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:23:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.650027 Apr 11 18:23:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 241/706] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:23:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:23:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d36ada58-86e5-4043-ad4f-77ccf41b0c20 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:05 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d36ada58-86e5-4043-ad4f-77ccf41b0c20 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:05 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:05 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d36ada58-86e5-4043-ad4f-77ccf41b0c20 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d36ada58-86e5-4043-ad4f-77ccf41b0c20 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 200 len: 1066 microversion: 2.1 time: 0.068607 Apr 11 18:23:05 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 232/707] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:05 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 1066 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:23:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Creating event network-changed:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:23:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032890 Apr 11 18:23:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:12 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6a6289d2-e522-495b-a7f2-5a447cf6005a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1717 microversion: 2.1 time: 0.160394 Apr 11 18:23:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 242/709] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:11 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:13 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9e84d230-c380-42c5-9261-64136cd97267 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1589 microversion: 2.20 time: 0.156561 Apr 11 18:23:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 233/710] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:23:13 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1589 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:23:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "name": "network-vif-plugged", "status": "completed", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Creating event network-vif-plugged:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:23:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Apr 11 18:23:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 236/711] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "name": "network-vif-plugged", "status": "completed", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Creating event network-vif-plugged:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:23:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 Apr 11 18:23:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 243/712] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=5 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:23 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-740590c8-07af-4be6-8b08-2bdb39bd3fb9 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1654 microversion: 2.1 time: 0.164189 Apr 11 18:23:23 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 234/713] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:23 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=12 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1868063970", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "c65d6737-91d9-40cd-a03c-f8049dc621fe"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] validate_networks() for [('c65d6737-91d9-40cd-a03c-f8049dc621fe', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for user fde784625fda4447afc0b8e9bd0983a3 and project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:23:42 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:23:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.640258 Apr 11 18:23:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 237/714] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:23:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=9 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:43 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:43 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9088bc43-1f96-4da0-b77b-5a314148c8c8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1395 microversion: 2.87 time: 0.086061 Apr 11 18:23:43 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 244/715] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:23:43 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:23:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 204 len: 0 microversion: 2.1 time: 0.130219 Apr 11 18:23:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 235/716] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:23:45 2023] DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Creating event network-changed:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:23:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030803 Apr 11 18:23:45 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 245/717] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-unplugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Creating event network-vif-unplugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:23:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029527 Apr 11 18:23:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 236/718] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:45 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:45 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-4944b98d-3694-4001-9a20-19a3d50a30fe tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 200 len: 1726 microversion: 2.1 time: 0.303844 Apr 11 18:23:45 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 238/719] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:45 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 1726 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:23:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-deleted", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] Creating event network-vif-deleted:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:23:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028867 Apr 11 18:23:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 246/720] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adc9f1d-cc32-446e-9ffc-5fada2383164", "name": "network-vif-plugged", "status": "completed", "tag": "98cc8035-8d3e-47cf-9758-c7172120ac70"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Creating event network-vif-plugged:98cc8035-8d3e-47cf-9758-c7172120ac70 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 on user Apr 11 18:23:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027312 Apr 11 18:23:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 237/721] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:55 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:23:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6ee573b0-7156-481e-9b4c-02037bbb8b5e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 200 len: 1393 microversion: 2.1 time: 0.162010 Apr 11 18:23:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 239/722] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:23:55 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:23:56 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:23:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:23:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034098 Apr 11 18:23:56 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 238/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30422a52-74c1-4245-8cb1-8a363674796d", "device": "/dev/vdb"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482469 Apr 11 18:23:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 247/724] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:23:56 2023] POST /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:23:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:23:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:23:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:23:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:23:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:23:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031208 Apr 11 18:23:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 240/725] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:09 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'services' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:24:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048/os-volume_attachments/30422a52-74c1-4245-8cb1-8a363674796d" status: 202 len: 0 microversion: 2.1 time: 0.170588 Apr 11 18:24:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 239/726] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:24:09 2023] DELETE /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048/os-volume_attachments/30422a52-74c1-4245-8cb1-8a363674796d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:24:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048" status: 204 len: 0 microversion: 2.1 time: 0.118046 Apr 11 18:24:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 248/727] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:24:09 2023] DELETE /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=16 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:10 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-35e81976-4471-4ad9-901e-255481476144 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048" status: 200 len: 1548 microversion: 2.1 time: 0.197246 Apr 11 18:24:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 241/728] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:09 2023] GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 => generated 1548 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:24:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Creating event network-vif-unplugged:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:24:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033436 Apr 11 18:24:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 240/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b01c8e2a-ee2d-43ee-8884-9ba6a4fb7297 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091217 Apr 11 18:24:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 249/730] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:24:12 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "name": "network-vif-deleted", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:12 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] Creating event network-vif-deleted:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:24:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Apr 11 18:24:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 242/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Creating event network-changed:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:24:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029368 Apr 11 18:24:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 241/732] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'services' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:24:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments/ab2addce-fd37-48c2-be0e-131ebef2ce29" status: 202 len: 0 microversion: 2.1 time: 0.166005 Apr 11 18:24:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 243/733] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:24:13 2023] DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments/ab2addce-fd37-48c2-be0e-131ebef2ce29 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2b20141a-8336-45d5-8852-4d6eda0a33cd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057978 Apr 11 18:24:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 242/734] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:24:13 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37cbdb-1665-41de-bac9-b7fcf976c048", "name": "network-vif-plugged", "status": "completed", "tag": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Creating event network-vif-plugged:3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 on user Apr 11 18:24:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 Apr 11 18:24:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 244/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:13 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9c6f4769-cfd0-425f-93c9-68353a8b4259 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.669105 Apr 11 18:24:13 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 250/736] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 18:24:13 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-interface => generated 283 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:24:14 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Creating event network-changed:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:24:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027970 Apr 11 18:24:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 243/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e74d78dd-2735-41ac-922c-1961662ca5c2 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/ips" status: 200 len: 111 microversion: 2.20 time: 0.036294 Apr 11 18:24:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 245/738] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 18:24:15 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/ips => generated 111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:24:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Creating event network-changed:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:24:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033379 Apr 11 18:24:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 251/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:16 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'flavor' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:24:17 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/action" status: 202 len: 0 microversion: 2.20 time: 0.813620 Apr 11 18:24:17 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 244/740] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:24:16 2023] POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:17 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-3f65259c-de94-45b7-968f-dd257cea2f2b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1714 microversion: 2.20 time: 0.216733 Apr 11 18:24:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 246/741] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:24:17 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1714 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:24:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-unplugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:17 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:17 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Creating event network-vif-unplugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:24:17 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032763 Apr 11 18:24:17 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 252/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:24:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 Apr 11 18:24:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 245/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:22 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:22 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Creating event network-changed:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:24:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039407 Apr 11 18:24:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 247/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-5f597a82-7afc-40f2-ad57-d46472a031d8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046627 Apr 11 18:24:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 253/745] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:24:23 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:24 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:24:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 204 len: 0 microversion: 2.1 time: 0.107250 Apr 11 18:24:24 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 246/746] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:24:24 2023] DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:24 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:24 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6a1d69d5-d6fe-4550-9b47-fa460a0209ee tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 200 len: 1660 microversion: 2.1 time: 0.191614 Apr 11 18:24:24 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 248/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:24 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 1660 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:24:24 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-unplugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:24 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Creating event network-vif-unplugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:24:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029229 Apr 11 18:24:24 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 254/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-deleted", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] Creating event network-vif-deleted:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:24:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Apr 11 18:24:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 247/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7908f28-28c2-4b9a-b804-042f0d186691", "name": "network-vif-plugged", "status": "completed", "tag": "73d8e6ed-570b-444e-a062-22d66314138a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Creating event network-vif-plugged:73d8e6ed-570b-444e-a062-22d66314138a for instance e7908f28-28c2-4b9a-b804-042f0d186691 on user Apr 11 18:24:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Apr 11 18:24:26 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 249/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:33 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-27329c77-c587-4425-9f99-e154424c7227 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1767 microversion: 2.87 time: 0.191936 Apr 11 18:24:33 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 255/751] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:24:33 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1767 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:24:35 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 HTTP/1.1 Apr 11 18:24:35 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:24:35 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:24:35 user devstack@n-api.service[72343]: Connection: close Apr 11 18:24:35 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:24:35 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:24:35 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:24:35 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:24:35 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:35 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:24:35 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:24:35 user devstack@n-api.service[72343]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:24:35 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:35 user devstack@n-api.service[72343]: method: > Apr 11 18:24:35 user devstack@n-api.service[72343]: exception: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:35 user devstack@n-api.service[72343]: action_args: {'id': '1adc9f1d-cc32-446e-9ffc-5fada2383164'} Apr 11 18:24:35 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:24:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:24:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5e18f8dd-3c15-4d95-bc79-2b2d45f44c78 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 404 len: 111 microversion: 2.1 time: 0.034658 Apr 11 18:24:35 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 248/752] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:35 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:36 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:24:36 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments HTTP/1.1 Apr 11 18:24:36 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:24:36 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:24:36 user devstack@n-api.service[72345]: Connection: close Apr 11 18:24:36 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:24:36 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:24:36 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:24:36 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:24:36 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:36 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:24:36 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:24:36 user devstack@n-api.service[72345]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:24:36 user devstack@n-api.service[72345]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:36 user devstack@n-api.service[72345]: method: > Apr 11 18:24:36 user devstack@n-api.service[72345]: exception: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72345]: action_args: {'server_id': '1adc9f1d-cc32-446e-9ffc-5fada2383164'} Apr 11 18:24:36 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:24:36 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-40762c23-7f0d-4e8a-a2c3-66fb3b31d3a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030438 Apr 11 18:24:36 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 250/753] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:24:35 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:36 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:24:36 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 HTTP/1.1 Apr 11 18:24:36 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:24:36 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:24:36 user devstack@n-api.service[72344]: Connection: close Apr 11 18:24:36 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:24:36 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:24:36 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:24:36 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:24:36 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:36 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:24:36 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:24:36 user devstack@n-api.service[72344]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:24:36 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:24:36 user devstack@n-api.service[72344]: method: > Apr 11 18:24:36 user devstack@n-api.service[72344]: exception: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72344]: action_args: {'id': '1adc9f1d-cc32-446e-9ffc-5fada2383164'} Apr 11 18:24:36 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:24:36 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:24:36 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:24:36 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9dced899-3f1f-423c-84dd-7d3d4971346a tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 404 len: 111 microversion: 2.1 time: 0.027542 Apr 11 18:24:36 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 256/754] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:36 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2109686306", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "6960067f-92d2-4975-8467-4b8d4d2f9933"}], "security_groups": [{"name": "tempest-securitygroup--14530514"}], "key_name": "tempest-keypair-154558437", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] validate_networks() for [('6960067f-92d2-4975-8467-4b8d4d2f9933', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:24:36 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:24:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:24:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917810 Apr 11 18:24:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 249/755] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:24:36 2023] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:24:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-fa0463bb-c046-4f37-a336-4a89a6f01e44 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-fa0463bb-c046-4f37-a336-4a89a6f01e44 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:37 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-fa0463bb-c046-4f37-a336-4a89a6f01e44 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-fa0463bb-c046-4f37-a336-4a89a6f01e44 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 200 len: 1232 microversion: 2.1 time: 0.141093 Apr 11 18:24:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 251/756] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:37 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 1232 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:24:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Creating event network-changed:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:24:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030871 Apr 11 18:24:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 257/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:41 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "name": "network-vif-plugged", "status": "completed", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Creating event network-vif-plugged:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:24:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045112 Apr 11 18:24:41 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 250/758] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "name": "network-vif-plugged", "status": "completed", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=25 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:43 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Creating event network-vif-plugged:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:24:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055223 Apr 11 18:24:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 252/759] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:55 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:55 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-fad39137-a3c6-4263-a19b-d45c5d865a93 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 200 len: 1393 microversion: 2.1 time: 0.172253 Apr 11 18:24:55 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 258/760] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:55 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1701323259"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:55 user devstack@n-api.service[72343]: INFO nova.compute.api [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Attempting to quiesce instance before volume snapshot. Apr 11 18:24:55 user devstack@n-api.service[72343]: INFO nova.compute.api [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 18:24:55 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Creating snapshot from volume 94331799-c0ed-4258-962d-d21d01e8de14. {{(pid=72343) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 18:24:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c4f176e6-89c0-4a59-bee5-d3a6fb133428 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9/action" status: 202 len: 0 microversion: 2.1 time: 2.391781 Apr 11 18:24:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 251/761] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:24:55 2023] POST /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9/action => generated 0 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-473236277", "imageRef": "dc2a2ec9-eac7-4c6e-a001-0159eb253657", "flavorRef": "42", "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:24:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='de2bec89-492e-43fb-9030-13bed6ed9431',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:24:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.555661 Apr 11 18:24:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 253/762] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:24:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:24:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3c4e54d0-b309-4694-a3af-548257bfd920 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:24:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3c4e54d0-b309-4694-a3af-548257bfd920 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:24:58 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3c4e54d0-b309-4694-a3af-548257bfd920 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:24:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3c4e54d0-b309-4694-a3af-548257bfd920 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 200 len: 1223 microversion: 2.1 time: 0.061339 Apr 11 18:24:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 259/763] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:24:58 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 1223 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] HTTP exception thrown: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Request method failure captured: Apr 11 18:25:00 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 HTTP/1.1 Apr 11 18:25:00 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:25:00 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:25:00 user devstack@n-api.service[72343]: Connection: close Apr 11 18:25:00 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:25:00 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:25:00 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:25:00 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:25:00 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaSQuehIzX5QWeMjAMLuYA7bT24Pqf211dZblI5HfaV1JxrEDejVMAcV8oy1ZlMUpBo92zQA1hewsmmSNodvYB718eol5WJPlGPLVparYfyr4Wd57rV7jYujU-He58Bq4uE7jGPkQF8FncL9TioC6q6QirudqUzJojAx1EK2gdjzfss Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Project-Id: fde6ebc41bed44f1a04e23e62cd9ac0d Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Project-Name: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fde6ebc41bed44f1a04e23e62cd9ac0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Tenant: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Tenant-Id: fde6ebc41bed44f1a04e23e62cd9ac0d Apr 11 18:25:00 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-251988417 Apr 11 18:25:00 user devstack@n-api.service[72343]: X-User: tempest-VolumesSnapshotTestJSON-251988417-project-member Apr 11 18:25:00 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:25:00 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:25:00 user devstack@n-api.service[72343]: X-User-Id: 5fdf10ea561448f689cdd2d052080168 Apr 11 18:25:00 user devstack@n-api.service[72343]: X-User-Name: tempest-VolumesSnapshotTestJSON-251988417-project-member Apr 11 18:25:00 user devstack@n-api.service[72343]: method: > Apr 11 18:25:00 user devstack@n-api.service[72343]: exception: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. Apr 11 18:25:00 user devstack@n-api.service[72343]: action_args: {'id': 'bc37cbdb-1665-41de-bac9-b7fcf976c048'} Apr 11 18:25:00 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. Apr 11 18:25:00 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Returning 404 to user: Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:25:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d77f54f5-1e6f-4a90-900f-45bb646bdcd5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048" status: 404 len: 111 microversion: 2.1 time: 0.032007 Apr 11 18:25:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 252/764] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:00 2023] GET /compute/v2.1/servers/bc37cbdb-1665-41de-bac9-b7fcf976c048 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:25:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Creating event network-changed:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:25:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031727 Apr 11 18:25:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 254/765] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f45855d1-34e8-47db-ba23-3947bb59b996 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045378 Apr 11 18:25:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 260/766] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:25:03 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:25:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 204 len: 0 microversion: 2.1 time: 0.114467 Apr 11 18:25:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 253/767] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:25:03 2023] DELETE /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:04 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e0618cfc-a8ce-4fa5-9628-738836104537 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 200 len: 1677 microversion: 2.1 time: 0.221266 Apr 11 18:25:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 255/768] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:03 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-unplugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Creating event network-vif-unplugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:25:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029890 Apr 11 18:25:04 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 261/769] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-plugged", "status": "completed", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Creating event network-vif-plugged:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:25:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Apr 11 18:25:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 254/770] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a2e113-75f7-47ac-bdf9-458793a62061", "name": "network-vif-deleted", "tag": "2de8f180-0b9b-405b-abcd-f44d2c15a437"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] Creating event network-vif-deleted:2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 on user Apr 11 18:25:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033294 Apr 11 18:25:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 256/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:07 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:07 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6503871a-340b-413a-86d6-77781bc314ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1655 microversion: 2.20 time: 0.164172 Apr 11 18:25:07 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 262/772] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:25:07 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:25:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "name": "network-vif-plugged", "status": "completed", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Creating event network-vif-plugged:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:25:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300972 Apr 11 18:25:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 255/773] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:25:14 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 HTTP/1.1 Apr 11 18:25:14 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:25:14 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:25:14 user devstack@n-api.service[72345]: Connection: close Apr 11 18:25:14 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:25:14 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:25:14 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:25:14 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:25:14 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:25:14 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:25:14 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:25:14 user devstack@n-api.service[72345]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:25:14 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:25:14 user devstack@n-api.service[72345]: method: > Apr 11 18:25:14 user devstack@n-api.service[72345]: exception: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:25:14 user devstack@n-api.service[72345]: action_args: {'id': 'e7908f28-28c2-4b9a-b804-042f0d186691'} Apr 11 18:25:14 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:25:14 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:25:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:25:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-3285d5d8-09e8-4386-8bfe-605790d87d7a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 404 len: 111 microversion: 2.1 time: 0.047738 Apr 11 18:25:14 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 257/774] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:14 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:25:14 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ae175675-ed81-430e-a458-a600f9cf65fe tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '.version_select at 0x7fadb9474d30>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ae175675-ed81-430e-a458-a600f9cf65fe tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353094075" status: 202 len: 0 microversion: 2.1 time: 0.025789 Apr 11 18:25:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 263/775] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:25:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353094075 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:25:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d04bee89-de24-4b94-8f07-a0bb729207a3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: .version_select at 0x7fadb9665bd0>, body: {"keypair": {"name": "tempest-keypair-1800185275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqSkOsVWWiQJY+4Uhu/FVlYzwpA9r4NiOcAw/vTuyzs+NADfEQsbFTqqlwK/uPXN4CA0MSgtJUJtml4jJTgDvkQuRFevMxDr03QFffyWHyb3yDt1o4/Scj9arSvVLcxfA=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:15 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-d04bee89-de24-4b94-8f07-a0bb729207a3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for project d77a56502d9848a3842c938d5adc8c51. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:25:15 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-d04bee89-de24-4b94-8f07-a0bb729207a3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for user b852c50aeb514b7fbe5a9b72e8bbdc14 and project d77a56502d9848a3842c938d5adc8c51. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:25:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d04bee89-de24-4b94-8f07-a0bb729207a3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060039 Apr 11 18:25:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 256/776] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:25:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "name": "network-vif-plugged", "status": "completed", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Creating event network-vif-plugged:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:25:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036295 Apr 11 18:25:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 258/777] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:17 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1211420081", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b10563fa-e007-4ce1-9088-f81d415728c4"}], "security_groups": [{"name": "tempest-securitygroup--238194349"}], "key_name": "tempest-keypair-1800185275", "user_data": "}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:17 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] validate_networks() for [('b10563fa-e007-4ce1-9088-f81d415728c4', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:25:17 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=20 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for project d77a56502d9848a3842c938d5adc8c51. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting quotas for user b852c50aeb514b7fbe5a9b72e8bbdc14 and project d77a56502d9848a3842c938d5adc8c51. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:25:18 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:25:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.211872 Apr 11 18:25:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 264/778] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:25:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:25:18 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-005dbbc5-8475-414a-bb47-41dc1061ebde tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:18 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-005dbbc5-8475-414a-bb47-41dc1061ebde tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:18 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-005dbbc5-8475-414a-bb47-41dc1061ebde tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:18 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-005dbbc5-8475-414a-bb47-41dc1061ebde tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 200 len: 1232 microversion: 2.1 time: 0.152399 Apr 11 18:25:18 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 257/779] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:18 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 1232 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Creating event network-changed:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:25:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029528 Apr 11 18:25:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 259/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "name": "network-vif-plugged", "status": "completed", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Creating event network-vif-plugged:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:25:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051285 Apr 11 18:25:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 265/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "name": "network-vif-plugged", "status": "completed", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Creating event network-vif-plugged:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:25:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073996 Apr 11 18:25:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 258/782] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:27 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-31bfc38a-b37c-41ad-93e3-f4ae05b106b2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 200 len: 1537 microversion: 2.1 time: 0.335784 Apr 11 18:25:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 260/783] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:27 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 1537 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0054f394-9912-47f5-b40e-89b05f0e018a"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:33 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'flavor' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:25:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf/action" status: 200 len: 29 microversion: 2.87 time: 0.603612 Apr 11 18:25:34 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 266/784] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:25:33 2023] POST /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf/action => generated 29 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:34 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:34 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-37fd612f-8dc0-4a82-96db-e111ee483fdd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1773 microversion: 2.87 time: 0.243756 Apr 11 18:25:34 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 259/785] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:25:34 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1773 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:35 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=26 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:35 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Creating event network-vif-unplugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:25:35 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032706 Apr 11 18:25:35 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 261/786] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:37 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:25:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029521 Apr 11 18:25:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 267/787] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:25:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Apr 11 18:25:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 260/788] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:25:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094124 Apr 11 18:25:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 262/789] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:49 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-fba6f63b-cd62-469a-ad12-4da4d13ca8fd tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 200 len: 1550 microversion: 2.1 time: 0.263919 Apr 11 18:25:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 268/790] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:48 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 1550 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=7 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=10 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HTTP exception thrown: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Request method failure captured: Apr 11 18:25:54 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 HTTP/1.1 Apr 11 18:25:54 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:25:54 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:25:54 user devstack@n-api.service[72343]: Connection: close Apr 11 18:25:54 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:25:54 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:25:54 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:25:54 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:25:54 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ3xoWpA6L6sJDUdOd8AExbBGkGdm0qz8n435SJOLLg4ULs4B7aG2c1bJHYh0qnXRM-k9IQThZm2fiVkH9nH5TCuCTtC9SIEpEvjHnYebgTEEAF0nZuw7F41zUga4NdnvnoJ4ZbX_WODBfNPtfgvtFdKqoTscgLbnT3iQhM1z9hXcU Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Project-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Tenant-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:25:54 user devstack@n-api.service[72343]: X-User: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:25:54 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:25:54 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:25:54 user devstack@n-api.service[72343]: X-User-Id: 908e0b5a1ce14f5cb636eda79ac77f7b Apr 11 18:25:54 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:25:54 user devstack@n-api.service[72343]: method: > Apr 11 18:25:54 user devstack@n-api.service[72343]: exception: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. Apr 11 18:25:54 user devstack@n-api.service[72343]: action_args: {'id': 'c5a2e113-75f7-47ac-bdf9-458793a62061'} Apr 11 18:25:54 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. Apr 11 18:25:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:25:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Returning 404 to user: Instance c5a2e113-75f7-47ac-bdf9-458793a62061 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:25:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e74706b6-1e2e-4720-8b5a-b3b3f0193295 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061" status: 404 len: 111 microversion: 2.1 time: 0.034723 Apr 11 18:25:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 261/791] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:54 2023] GET /compute/v2.1/servers/c5a2e113-75f7-47ac-bdf9-458793a62061 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:25:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:25:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9df65db9-317a-497b-84fe-4f4fae7725aa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '.version_select at 0x7fadb9409c60>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9df65db9-317a-497b-84fe-4f4fae7725aa tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641901033" status: 202 len: 0 microversion: 2.1 time: 0.034351 Apr 11 18:25:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 263/792] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:25:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641901033 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:25:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 204 len: 0 microversion: 2.1 time: 0.159687 Apr 11 18:25:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 269/793] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:25:57 2023] DELETE /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:57 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:25:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-265fdf45-d8ad-4627-8cbe-a27833bbe5a0 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 200 len: 1496 microversion: 2.1 time: 0.197630 Apr 11 18:25:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 262/794] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:25:57 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:25:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-unplugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Creating event network-vif-unplugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:25:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033877 Apr 11 18:25:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 264/795] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-deleted", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] Creating event network-vif-deleted:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:25:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106087 Apr 11 18:25:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 270/796] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:25:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216db027-e3a6-4027-9aa7-07031623c674", "name": "network-vif-plugged", "status": "completed", "tag": "416d3421-181a-44dd-9e4c-438c8289541d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:25:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:25:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:25:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:25:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Creating event network-vif-plugged:416d3421-181a-44dd-9e4c-438c8289541d for instance 216db027-e3a6-4027-9aa7-07031623c674 on user Apr 11 18:25:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028337 Apr 11 18:25:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 263/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f30a9827-9ac3-49c8-850d-5ab5e382d82f"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-86c18a38-7b75-4edf-9a84-b7ef08af2604 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.461886 Apr 11 18:26:08 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 265/798] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 18:26:07 2023] POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments => generated 188 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4c2b2bc5-0981-4c1f-b3e4-7878912b512e tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments/f30a9827-9ac3-49c8-850d-5ab5e382d82f" status: 202 len: 0 microversion: 2.20 time: 0.246849 Apr 11 18:26:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 271/799] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 18:26:08 2023] DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments/f30a9827-9ac3-49c8-850d-5ab5e382d82f => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72343) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/action" status: 202 len: 0 microversion: 2.20 time: 0.182876 Apr 11 18:26:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 264/800] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:26:08 2023] POST /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:09 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-44eb3711-77ad-4a8e-a7c5-7e0d62502fe6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 200 len: 1536 microversion: 2.1 time: 0.286577 Apr 11 18:26:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:08 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 1536 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:26:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:09 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-296ffe89-f4af-4c25-8dd7-760c524d136d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1663 microversion: 2.20 time: 0.164662 Apr 11 18:26:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 272/802] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:26:08 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:26:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Creating event network-changed:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:26:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 Apr 11 18:26:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 265/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:26:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413333 Apr 11 18:26:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 267/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:26:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041579 Apr 11 18:26:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 273/805] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:24 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-fb672bd3-59a9-47f4-8457-853af99c737c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1753 microversion: 2.87 time: 0.282670 Apr 11 18:26:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 266/806] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:26:24 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1753 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a672a2bc-f207-4881-90d0-c69e99cd5ef8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.195730 Apr 11 18:26:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 268/807] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:26:27 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b/os-interface => generated 283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Creating event network-changed:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:26:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036573 Apr 11 18:26:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 274/808] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1486538402", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "6960067f-92d2-4975-8467-4b8d4d2f9933"}], "security_groups": [{"name": "tempest-securitygroup--14530514"}], "key_name": "tempest-keypair-154558437", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "eb51b2ca-fd24-41b8-bc39-fc11e130b55b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] validate_networks() for [('6960067f-92d2-4975-8467-4b8d4d2f9933', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:26:30 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb51b2ca-fd24-41b8-bc39-fc11e130b55b',volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:26:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746727 Apr 11 18:26:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 267/809] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:26:30 2023] POST /compute/v2.1/servers => generated 402 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:26:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-22ab6b15-c346-41a1-b1d4-fc038c5e8ee5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:31 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-22ab6b15-c346-41a1-b1d4-fc038c5e8ee5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:31 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-22ab6b15-c346-41a1-b1d4-fc038c5e8ee5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-22ab6b15-c346-41a1-b1d4-fc038c5e8ee5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1075 microversion: 2.1 time: 0.070755 Apr 11 18:26:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 269/810] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:31 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1075 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:26:33 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:33 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Creating event network-changed:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:26:33 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034062 Apr 11 18:26:33 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 275/811] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:26:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028754 Apr 11 18:26:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 268/812] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:26:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Apr 11 18:26:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 270/813] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HTTP exception thrown: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Request method failure captured: Apr 11 18:26:47 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 HTTP/1.1 Apr 11 18:26:47 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:26:47 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:26:47 user devstack@n-api.service[72344]: Connection: close Apr 11 18:26:47 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:26:47 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:26:47 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:26:47 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:26:47 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ3xoWpA6L6sJDUdOd8AExbBGkGdm0qz8n435SJOLLg4ULs4B7aG2c1bJHYh0qnXRM-k9IQThZm2fiVkH9nH5TCuCTtC9SIEpEvjHnYebgTEEAF0nZuw7F41zUga4NdnvnoJ4ZbX_WODBfNPtfgvtFdKqoTscgLbnT3iQhM1z9hXcU Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Project-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Tenant-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:26:47 user devstack@n-api.service[72344]: X-User: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:26:47 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:26:47 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:26:47 user devstack@n-api.service[72344]: X-User-Id: 908e0b5a1ce14f5cb636eda79ac77f7b Apr 11 18:26:47 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:26:47 user devstack@n-api.service[72344]: method: > Apr 11 18:26:47 user devstack@n-api.service[72344]: exception: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. Apr 11 18:26:47 user devstack@n-api.service[72344]: action_args: {'id': '216db027-e3a6-4027-9aa7-07031623c674'} Apr 11 18:26:47 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. Apr 11 18:26:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:26:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Returning 404 to user: Instance 216db027-e3a6-4027-9aa7-07031623c674 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:26:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d1a7c1e8-7877-4193-b402-167079425b9a tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674" status: 404 len: 111 microversion: 2.1 time: 0.133511 Apr 11 18:26:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 276/814] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:47 2023] GET /compute/v2.1/servers/216db027-e3a6-4027-9aa7-07031623c674 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:26:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 204 len: 0 microversion: 2.1 time: 0.120344 Apr 11 18:26:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 269/815] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:26:47 2023] DELETE /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:47 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-64aa5e80-212d-4542-b50e-3b8e0c136b94 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 200 len: 1510 microversion: 2.1 time: 0.191196 Apr 11 18:26:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:47 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:26:48 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:48 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Creating event network-vif-unplugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:26:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029398 Apr 11 18:26:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 277/817] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3f7b2d0c-0e4e-4b0e-b927-7f94abe8021b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 200 len: 1550 microversion: 2.1 time: 0.184906 Apr 11 18:26:49 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 270/818] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:49 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:26:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 204 len: 0 microversion: 2.1 time: 0.181298 Apr 11 18:26:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 272/819] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:26:49 2023] DELETE /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:49 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-930756a7-b91d-485c-a13b-98977ca9e899 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 200 len: 1556 microversion: 2.1 time: 0.165959 Apr 11 18:26:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 278/820] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:26:49 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:26:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-plugged", "status": "completed", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "253a1b67-06b0-4308-a2fc-78f36cda0ab8", "name": "network-vif-deleted", "tag": "3097aae4-0511-4a73-883d-3366bfa914b7"}, {"server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "name": "network-vif-unplugged", "status": "completed", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Creating event network-vif-plugged:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:26:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Creating event network-vif-deleted:3097aae4-0511-4a73-883d-3366bfa914b7 for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 on user Apr 11 18:26:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Creating event network-vif-unplugged:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:26:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034734 Apr 11 18:26:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 271/821] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "name": "network-vif-plugged", "status": "completed", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}, {"server_uuid": "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c", "name": "network-vif-deleted", "tag": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:26:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Creating event network-vif-plugged:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:26:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Creating event network-vif-deleted:6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c on user Apr 11 18:26:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039098 Apr 11 18:26:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 273/822] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:59 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:26:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4bffb5f3-ff57-4cf9-b2f3-c7b018041657 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1708 microversion: 2.20 time: 0.146956 Apr 11 18:26:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 279/823] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:26:59 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1708 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-171247a6-6596-4e30-98ed-73305792898b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.118081 Apr 11 18:27:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 272/824] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:27:09 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-interface => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:09 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:09 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:10 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Creating event network-changed:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:27:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044685 Apr 11 18:27:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=16 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f9613338-e48f-49c2-a9f9-1b38f4c3af4a tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/ips" status: 200 len: 103 microversion: 2.1 time: 0.038773 Apr 11 18:27:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 280/826] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:27:10 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/ips => generated 103 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280688 Apr 11 18:27:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 273/827] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:27:11 2023] POST /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:18 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:18 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-19afc8d0-9469-410a-ae9a-66d177f7a56f tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 Apr 11 18:27:18 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:27:18 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-87df264b-c852-4d34-87a2-70dfa3e80b78 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" status: 200 len: 194 microversion: 2.1 time: 0.046803 Apr 11 18:27:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 281/829] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 18:27:18 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e77769cb-0585-4e4a-a83c-38d84ba00811"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283197 Apr 11 18:27:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 274/830] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:27:19 2023] POST /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:21 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-06b6233c-3f64-4534-8d8d-84642a39bb3e tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1425 microversion: 2.1 time: 0.185565 Apr 11 18:27:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:27:21 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1425 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf/action" status: 202 len: 0 microversion: 2.87 time: 0.081872 Apr 11 18:27:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 282/832] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:27:25 2023] POST /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:25 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-5a1ce593-bca1-4e57-b10c-21c00a79a239 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1761 microversion: 2.87 time: 0.250671 Apr 11 18:27:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 275/833] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:27:25 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1761 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:27:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Creating event network-vif-unplugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:27:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032320 Apr 11 18:27:26 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 277/834] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-7cd0e47a-27c2-4814-ad20-77a3a5bd0f48 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044972 Apr 11 18:27:26 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 283/835] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:27:26 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-63b21bb6-769f-4c89-a063-bf7597de298e tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" status: 200 len: 194 microversion: 2.1 time: 0.038631 Apr 11 18:27:26 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 276/836] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 18:27:26 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:26 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'services' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:27:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" status: 202 len: 0 microversion: 2.1 time: 0.159954 Apr 11 18:27:26 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 278/837] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:27:26 2023] DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:27:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:27:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029886 Apr 11 18:27:28 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 284/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-18bdb6c9-7072-4bfd-813f-ed24572c56b6 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/e77769cb-0585-4e4a-a83c-38d84ba00811" status: 200 len: 194 microversion: 2.1 time: 0.041096 Apr 11 18:27:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 277/839] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 18:27:28 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/e77769cb-0585-4e4a-a83c-38d84ba00811 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:29 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'services' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:27:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/e77769cb-0585-4e4a-a83c-38d84ba00811" status: 202 len: 0 microversion: 2.1 time: 0.168824 Apr 11 18:27:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 279/840] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:27:29 2023] DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments/e77769cb-0585-4e4a-a83c-38d84ba00811 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:27:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}, {"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:27:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:27:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034843 Apr 11 18:27:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 285/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3d308d8f-8303-48ba-94a8-3328fb5309c8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042000 Apr 11 18:27:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 278/842] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:27:31 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b19c347f-13a9-4994-b63f-90a300f31ed2 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085911 Apr 11 18:27:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 280/843] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:27:31 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:27:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 204 len: 0 microversion: 2.1 time: 0.108477 Apr 11 18:27:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 286/844] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:27:31 2023] DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:32 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-4545e297-087d-4991-bc75-3dd5d63fafcf tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 200 len: 1660 microversion: 2.1 time: 0.206198 Apr 11 18:27:32 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 279/845] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:27:31 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 1660 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:27:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Creating event network-vif-unplugged:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:27:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041126 Apr 11 18:27:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 281/846] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:34 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "name": "network-vif-plugged", "status": "completed", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}, {"server_uuid": "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8", "name": "network-vif-deleted", "tag": "fab46756-563a-4dbb-bbb5-b2b4722e7a57"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:34 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Creating event network-vif-plugged:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:27:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Creating event network-vif-deleted:fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 on user Apr 11 18:27:34 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029233 Apr 11 18:27:34 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 287/847] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HTTP exception thrown: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Request method failure captured: Apr 11 18:27:38 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 HTTP/1.1 Apr 11 18:27:38 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:27:38 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:27:38 user devstack@n-api.service[72343]: Connection: close Apr 11 18:27:38 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:27:38 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:27:38 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:27:38 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:27:38 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ3xoWpA6L6sJDUdOd8AExbBGkGdm0qz8n435SJOLLg4ULs4B7aG2c1bJHYh0qnXRM-k9IQThZm2fiVkH9nH5TCuCTtC9SIEpEvjHnYebgTEEAF0nZuw7F41zUga4NdnvnoJ4ZbX_WODBfNPtfgvtFdKqoTscgLbnT3iQhM1z9hXcU Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Project-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10b5a531bbc41d680d137a766a8b2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Tenant-Id: c10b5a531bbc41d680d137a766a8b2d9 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-223229619 Apr 11 18:27:38 user devstack@n-api.service[72343]: X-User: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:27:38 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:27:38 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:27:38 user devstack@n-api.service[72343]: X-User-Id: 908e0b5a1ce14f5cb636eda79ac77f7b Apr 11 18:27:38 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-223229619-project-member Apr 11 18:27:38 user devstack@n-api.service[72343]: method: > Apr 11 18:27:38 user devstack@n-api.service[72343]: exception: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. Apr 11 18:27:38 user devstack@n-api.service[72343]: action_args: {'id': '253a1b67-06b0-4308-a2fc-78f36cda0ab8'} Apr 11 18:27:38 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. Apr 11 18:27:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:27:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Returning 404 to user: Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:27:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bd1269df-3744-4c27-8b3e-d92c8facbafe tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 10.0.0.210 "GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8" status: 404 len: 111 microversion: 2.1 time: 0.027696 Apr 11 18:27:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 280/848] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:27:38 2023] GET /compute/v2.1/servers/253a1b67-06b0-4308-a2fc-78f36cda0ab8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:27:39 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c HTTP/1.1 Apr 11 18:27:39 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:27:39 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:27:39 user devstack@n-api.service[72345]: Connection: close Apr 11 18:27:39 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:27:39 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:27:39 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:27:39 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:27:39 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:27:39 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:27:39 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:27:39 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:27:39 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:27:39 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:27:39 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:27:39 user devstack@n-api.service[72345]: method: > Apr 11 18:27:39 user devstack@n-api.service[72345]: exception: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:27:39 user devstack@n-api.service[72345]: action_args: {'id': 'ae5c052e-8a58-4adb-98b9-39f8a4c2a97c'} Apr 11 18:27:39 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:27:39 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:27:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:27:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-39701be5-5905-4b2d-a7c9-cd4dbd5ea8e1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 404 len: 111 microversion: 2.1 time: 0.033808 Apr 11 18:27:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 282/849] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:27:39 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:27:41 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 204 len: 0 microversion: 2.1 time: 0.137885 Apr 11 18:27:41 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 288/850] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:27:41 2023] DELETE /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=21 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:41 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:41 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-18c77408-b85e-4870-b13b-85a66531a4c5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 200 len: 1399 microversion: 2.1 time: 0.299858 Apr 11 18:27:41 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 281/851] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:27:41 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 1399 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:27:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "name": "network-vif-unplugged", "status": "completed", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Creating event network-vif-unplugged:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:27:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097436 Apr 11 18:27:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 283/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "name": "network-vif-deleted", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] Creating event network-vif-deleted:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:27:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028491 Apr 11 18:27:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 289/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:43 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a15a03-3576-4b80-a11d-f7fd838429e9", "name": "network-vif-plugged", "status": "completed", "tag": "1f623093-dd91-4d96-b18d-81470e690172"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:27:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:43 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Creating event network-vif-plugged:1f623093-dd91-4d96-b18d-81470e690172 for instance 88a15a03-3576-4b80-a11d-f7fd838429e9 on user Apr 11 18:27:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Apr 11 18:27:43 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 282/854] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:27:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=20 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-53c14123-0ea0-4de1-b2ef-a91d4b9961ea tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054983 Apr 11 18:27:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 284/855] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 18:27:59 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:27:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 204 len: 0 microversion: 2.20 time: 0.120376 Apr 11 18:27:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 290/856] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:27:59 2023] DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=7 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:27:59 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:00 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f7f96f8b-62a5-406f-ac6f-87739eabaa04 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 200 len: 1714 microversion: 2.20 time: 0.214725 Apr 11 18:28:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 283/857] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:27:59 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:28:00 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-unplugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:00 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Creating event network-vif-unplugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:28:00 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038354 Apr 11 18:28:00 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 285/858] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-deleted", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] Creating event network-vif-deleted:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:28:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028734 Apr 11 18:28:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 291/859] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:28:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ecc1bd-12b1-4834-989b-607cf2eb41e6", "name": "network-vif-plugged", "status": "completed", "tag": "480464a5-6cf9-4a50-b936-059cceecb02d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Creating event network-vif-plugged:480464a5-6cf9-4a50-b936-059cceecb02d for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 on user Apr 11 18:28:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 Apr 11 18:28:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 284/860] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=8 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:15 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ef52eca1-f63d-4075-bffa-d494d678d421 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1767 microversion: 2.87 time: 0.234171 Apr 11 18:28:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 286/861] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:28:15 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1767 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:21 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-724f7e51-1d59-4690-8dfd-018d5d9d4107 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.118573 Apr 11 18:28:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 292/862] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:28:21 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/os-interface => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:22 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:28:22 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 HTTP/1.1 Apr 11 18:28:22 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:28:22 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:28:22 user devstack@n-api.service[72343]: Connection: close Apr 11 18:28:22 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:28:22 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:28:22 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:28:22 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:28:22 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:22 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:28:22 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:28:22 user devstack@n-api.service[72343]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:28:22 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:22 user devstack@n-api.service[72343]: method: > Apr 11 18:28:22 user devstack@n-api.service[72343]: exception: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:22 user devstack@n-api.service[72343]: action_args: {'id': 'bba677b9-2c44-4f9c-a7d9-7e9098c98fb8'} Apr 11 18:28:22 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:22 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:22 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:22 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9ccb62a4-4059-421b-9c5d-fbf88a793654 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 404 len: 111 microversion: 2.1 time: 0.050049 Apr 11 18:28:22 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 285/863] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:22 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:22 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6f1ffd01-a8e5-4261-9e39-d9518dd028fa tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '.version_select at 0x7fadb95b40d0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:22 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6f1ffd01-a8e5-4261-9e39-d9518dd028fa tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800185275" status: 202 len: 0 microversion: 2.1 time: 0.036214 Apr 11 18:28:22 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 287/864] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:28:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800185275 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Creating event network-changed:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:28:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039852 Apr 11 18:28:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 293/865] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:23 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6a8980b4-c4cd-4651-9c7b-e5ecbf92192d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1425 microversion: 2.1 time: 0.340816 Apr 11 18:28:23 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 286/866] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:23 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1425 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Old instance type m1.nano, new instance type m1.micro {{(pid=72345) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'ram', 'cores'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting quotas for user 5ea51d683a9e45529a4eafc2359be9c8 and project e49c5486b65e4d3eaab7c35fe84ac9c9. Resources: {'ram', 'cores'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:28:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:28:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action" status: 202 len: 0 microversion: 2.1 time: 0.381890 Apr 11 18:28:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 288/867] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:28:23 2023] POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:23 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:24 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:24 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4abf9621-0bab-4478-a8b0-51fa305ae960 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1434 microversion: 2.1 time: 0.207379 Apr 11 18:28:24 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 294/868] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:23 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1434 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:28:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Creating event network-changed:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:28:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033744 Apr 11 18:28:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 287/869] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:28:26 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 HTTP/1.1 Apr 11 18:28:26 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:26 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:26 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:26 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:26 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:26 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:26 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:26 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:26 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:26 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:26 user devstack@n-api.service[72345]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:28:26 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:26 user devstack@n-api.service[72345]: method: > Apr 11 18:28:26 user devstack@n-api.service[72345]: exception: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72345]: action_args: {'id': 'bba677b9-2c44-4f9c-a7d9-7e9098c98fb8'} Apr 11 18:28:26 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:26 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-26b12f4d-dab2-45c5-b7bd-4b57e8fd3ca7 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 404 len: 111 microversion: 2.1 time: 0.034429 Apr 11 18:28:26 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 289/870] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:28:25 2023] DELETE /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:28:26 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 HTTP/1.1 Apr 11 18:28:26 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:26 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:26 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:26 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:26 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:26 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:26 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:26 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:26 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:26 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:26 user devstack@n-api.service[72344]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:28:26 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:26 user devstack@n-api.service[72344]: method: > Apr 11 18:28:26 user devstack@n-api.service[72344]: exception: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72344]: action_args: {'id': 'bba677b9-2c44-4f9c-a7d9-7e9098c98fb8'} Apr 11 18:28:26 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. Apr 11 18:28:26 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:26 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:26 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-da0ab0a9-9cc6-45eb-9435-6461122281f5 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" status: 404 len: 111 microversion: 2.1 time: 0.029064 Apr 11 18:28:26 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 295/871] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:26 2023] GET /compute/v2.1/servers/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:26 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-unplugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:26 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Creating event network-vif-unplugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:28:26 user devstack@n-api.service[72343]: DEBUG nova.compute.api [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Instance d853cbf3-7869-416c-af88-0b01b498705a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:28:26 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048349 Apr 11 18:28:26 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 288/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:28:27 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 HTTP/1.1 Apr 11 18:28:27 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:27 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:27 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:27 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:27 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:27 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:27 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:27 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:27 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:27 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:27 user devstack@n-api.service[72345]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:28:27 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:27 user devstack@n-api.service[72345]: method: > Apr 11 18:28:27 user devstack@n-api.service[72345]: exception: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72345]: action_args: {'id': 'e7908f28-28c2-4b9a-b804-042f0d186691'} Apr 11 18:28:27 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6e6095a8-0fc0-4112-9db0-9725766f6bc0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 404 len: 111 microversion: 2.1 time: 0.027782 Apr 11 18:28:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 290/873] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:28:27 2023] DELETE /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HTTP exception thrown: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Request method failure captured: Apr 11 18:28:27 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 HTTP/1.1 Apr 11 18:28:27 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:27 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:27 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:27 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:27 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:27 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:27 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:27 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOcIelUhBp8bKis0uHaBeamMnLZPtPCFSmzoB1BpBn7voJTfl_OLT_7ou7isOOvCOPdkYD3XK9WfZnyjXI1uacGHUBxn5x81K8A2wqjenxhg2UR1jgFNEoPUL6OXpGrDYPdSv5Tfmvpa9ig5dQosFAgTDfrwPa0lbEJ2izWRzrBsCM Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Project-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d77a56502d9848a3842c938d5adc8c51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Tenant-Id: d77a56502d9848a3842c938d5adc8c51 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-369540173 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:27 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:27 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:27 user devstack@n-api.service[72344]: X-User-Id: b852c50aeb514b7fbe5a9b72e8bbdc14 Apr 11 18:28:27 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeTestJSON-369540173-project-member Apr 11 18:28:27 user devstack@n-api.service[72344]: method: > Apr 11 18:28:27 user devstack@n-api.service[72344]: exception: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72344]: action_args: {'id': 'e7908f28-28c2-4b9a-b804-042f0d186691'} Apr 11 18:28:27 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. Apr 11 18:28:27 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Returning 404 to user: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8ec2dbd8-e31b-4b42-a694-0c82cf1898d0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691" status: 404 len: 111 microversion: 2.1 time: 0.030308 Apr 11 18:28:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 296/874] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:27 2023] GET /compute/v2.1/servers/e7908f28-28c2-4b9a-b804-042f0d186691 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 18:28:28 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:28 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:28:28 user devstack@n-api.service[72343]: DEBUG nova.compute.api [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Instance d853cbf3-7869-416c-af88-0b01b498705a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:28:28 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038124 Apr 11 18:28:28 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 289/875] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:28:31 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 HTTP/1.1 Apr 11 18:28:31 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:31 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:31 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:31 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:31 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:31 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:31 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:31 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:28:31 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72345]: method: > Apr 11 18:28:31 user devstack@n-api.service[72345]: exception: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:31 user devstack@n-api.service[72345]: action_args: {'id': '88a15a03-3576-4b80-a11d-f7fd838429e9'} Apr 11 18:28:31 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:31 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f2ab4543-3073-466b-80eb-86e4d4f55cc5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 404 len: 111 microversion: 2.1 time: 0.033314 Apr 11 18:28:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 291/876] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:31 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:28:31 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c HTTP/1.1 Apr 11 18:28:31 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:31 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:31 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:31 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:31 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:31 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:31 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:31 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72344]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72344]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:28:31 user devstack@n-api.service[72344]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72344]: method: > Apr 11 18:28:31 user devstack@n-api.service[72344]: exception: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72344]: action_args: {'id': 'ae5c052e-8a58-4adb-98b9-39f8a4c2a97c'} Apr 11 18:28:31 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:31 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-27a5b99a-b9f3-4bb2-aed7-069f290e0807 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 404 len: 111 microversion: 2.1 time: 0.029436 Apr 11 18:28:31 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 297/877] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:28:31 2023] DELETE /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:28:31 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c HTTP/1.1 Apr 11 18:28:31 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:28:31 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:28:31 user devstack@n-api.service[72343]: Connection: close Apr 11 18:28:31 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:28:31 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:28:31 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:28:31 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:28:31 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:31 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:31 user devstack@n-api.service[72343]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:28:31 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:28:31 user devstack@n-api.service[72343]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:28:31 user devstack@n-api.service[72343]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:31 user devstack@n-api.service[72343]: method: > Apr 11 18:28:31 user devstack@n-api.service[72343]: exception: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72343]: action_args: {'id': 'ae5c052e-8a58-4adb-98b9-39f8a4c2a97c'} Apr 11 18:28:31 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. Apr 11 18:28:31 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-76fc1f71-56bf-4b2c-8b67-733313d47fd0 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" status: 404 len: 111 microversion: 2.1 time: 0.041370 Apr 11 18:28:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 290/878] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:31 2023] GET /compute/v2.1/servers/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:28:32 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 HTTP/1.1 Apr 11 18:28:32 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:32 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:32 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:32 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:32 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:32 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:32 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:32 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:32 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:32 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:32 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:32 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:28:32 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:32 user devstack@n-api.service[72345]: method: > Apr 11 18:28:32 user devstack@n-api.service[72345]: exception: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72345]: action_args: {'id': '88a15a03-3576-4b80-a11d-f7fd838429e9'} Apr 11 18:28:32 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-02f2d122-1c0d-48ee-8dad-126b0a18cba1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 404 len: 111 microversion: 2.1 time: 0.034171 Apr 11 18:28:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 292/879] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:28:32 2023] DELETE /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:28:32 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 HTTP/1.1 Apr 11 18:28:32 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:32 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:32 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:32 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:32 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:32 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:32 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:32 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:28:32 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:28:32 user devstack@n-api.service[72344]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:32 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:32 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:32 user devstack@n-api.service[72344]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:28:32 user devstack@n-api.service[72344]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:28:32 user devstack@n-api.service[72344]: method: > Apr 11 18:28:32 user devstack@n-api.service[72344]: exception: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72344]: action_args: {'id': '88a15a03-3576-4b80-a11d-f7fd838429e9'} Apr 11 18:28:32 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. Apr 11 18:28:32 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a11d7817-fa91-4458-ba45-4cd2538d8c28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9" status: 404 len: 111 microversion: 2.1 time: 0.038081 Apr 11 18:28:32 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 298/880] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:32 2023] GET /compute/v2.1/servers/88a15a03-3576-4b80-a11d-f7fd838429e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:28:32 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b278dabb-80bc-4f64-b6c3-9785312c0283 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: .version_select at 0x7fadb96671c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1952119330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:32 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-b278dabb-80bc-4f64-b6c3-9785312c0283 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:28:32 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-b278dabb-80bc-4f64-b6c3-9785312c0283 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:28:32 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b278dabb-80bc-4f64-b6c3-9785312c0283 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.047882 Apr 11 18:28:32 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 291/881] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:28:32 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-828402740", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1952119330", "security_groups": [{"name": "tempest-secgroup-smoke-1961961393"}], "block_device_mapping_v2": [{"uuid": "6709e067-9e56-479d-9981-a93cbfbf9296", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:36 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:37 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:28:37 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:28:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:28:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6709e067-9e56-479d-9981-a93cbfbf9296',volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:28:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.821040 Apr 11 18:28:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 293/882] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:28:36 2023] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:28:37 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d93ab332-cffb-4630-820f-1dad66b04ca1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:37 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-d93ab332-cffb-4630-820f-1dad66b04ca1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:37 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-d93ab332-cffb-4630-820f-1dad66b04ca1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:28:37 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d93ab332-cffb-4630-820f-1dad66b04ca1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 200 len: 1089 microversion: 2.1 time: 0.136551 Apr 11 18:28:37 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 299/883] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:28:37 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 1089 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:28:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:28:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Instance d853cbf3-7869-416c-af88-0b01b498705a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72343) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:28:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076932 Apr 11 18:28:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 292/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:40 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:40 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:28:40 user devstack@n-api.service[72345]: DEBUG nova.compute.api [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Instance d853cbf3-7869-416c-af88-0b01b498705a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72345) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 18:28:40 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077338 Apr 11 18:28:40 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 294/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:42 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=20 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Creating event network-changed:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:28:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080171 Apr 11 18:28:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 300/886] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "name": "network-vif-plugged", "status": "completed", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Creating event network-vif-plugged:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:28:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081487 Apr 11 18:28:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 293/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "name": "network-vif-plugged", "status": "completed", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Creating event network-vif-plugged:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:28:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039255 Apr 11 18:28:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 295/888] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:28:50 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 HTTP/1.1 Apr 11 18:28:50 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:50 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:50 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:50 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:50 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:50 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:50 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:50 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:50 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:50 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:50 user devstack@n-api.service[72344]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:28:50 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:50 user devstack@n-api.service[72344]: method: > Apr 11 18:28:50 user devstack@n-api.service[72344]: exception: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:50 user devstack@n-api.service[72344]: action_args: {'id': '17ecc1bd-12b1-4834-989b-607cf2eb41e6'} Apr 11 18:28:50 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:50 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:50 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:50 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f40b64eb-13bb-4732-bf2e-4219a9fa195d tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 404 len: 111 microversion: 2.20 time: 0.053896 Apr 11 18:28:50 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 301/889] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:28:50 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:28:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-fe4d812d-53f8-4d43-ad88-4b159d6ad10a tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '.version_select at 0x7fadb9667be0>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:50 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-fe4d812d-53f8-4d43-ad88-4b159d6ad10a tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067458808" status: 204 len: 0 microversion: 2.20 time: 0.031760 Apr 11 18:28:50 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 294/890] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 18:28:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067458808 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:28:52 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 HTTP/1.1 Apr 11 18:28:52 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:52 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:52 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:52 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:52 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:52 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:52 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:52 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:52 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:52 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:52 user devstack@n-api.service[72345]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:28:52 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:52 user devstack@n-api.service[72345]: method: > Apr 11 18:28:52 user devstack@n-api.service[72345]: exception: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72345]: action_args: {'id': '17ecc1bd-12b1-4834-989b-607cf2eb41e6'} Apr 11 18:28:52 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ecf380fa-70e5-4677-995c-cc0a43bc9a81 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 404 len: 111 microversion: 2.20 time: 0.050787 Apr 11 18:28:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 296/891] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:28:52 2023] DELETE /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=23 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:28:52 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 HTTP/1.1 Apr 11 18:28:52 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:28:52 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:28:52 user devstack@n-api.service[72344]: Connection: close Apr 11 18:28:52 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:28:52 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:28:52 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:28:52 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:28:52 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:52 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:28:52 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:28:52 user devstack@n-api.service[72344]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:28:52 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:52 user devstack@n-api.service[72344]: method: > Apr 11 18:28:52 user devstack@n-api.service[72344]: exception: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72344]: action_args: {'id': '17ecc1bd-12b1-4834-989b-607cf2eb41e6'} Apr 11 18:28:52 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. Apr 11 18:28:52 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:28:52 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f6f2b8fd-0581-4004-b20f-c48e25cd1780 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6" status: 404 len: 111 microversion: 2.20 time: 0.037277 Apr 11 18:28:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 302/892] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:28:52 2023] GET /compute/v2.1/servers/17ecc1bd-12b1-4834-989b-607cf2eb41e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=27 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:28:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:28:53 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 HTTP/1.1 Apr 11 18:28:53 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:28:53 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:28:53 user devstack@n-api.service[72343]: Connection: close Apr 11 18:28:53 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:28:53 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:28:53 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:28:53 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:28:53 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:53 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:28:53 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:28:53 user devstack@n-api.service[72343]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:28:53 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:53 user devstack@n-api.service[72343]: method: > Apr 11 18:28:53 user devstack@n-api.service[72343]: exception: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72343]: action_args: {'id': '582e004b-a2f3-4397-9ccb-d23f5724ebe1'} Apr 11 18:28:53 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:53 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d9d93c09-86d1-4262-bdf4-6911c37f88ca tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 404 len: 111 microversion: 2.20 time: 0.052295 Apr 11 18:28:53 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 295/893] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:28:53 2023] DELETE /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:28:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HTTP exception thrown: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Request method failure captured: Apr 11 18:28:53 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 HTTP/1.1 Apr 11 18:28:53 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:28:53 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:28:53 user devstack@n-api.service[72345]: Connection: close Apr 11 18:28:53 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:28:53 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:28:53 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:28:53 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:28:53 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaOi-un3e53R8oYAA8z5FY1eXLkM6cw-SbBh57BNpiKPvKidOzYT6uayHxQKdCtLEC2qga5JMqzw5Gek88pgFpamFv7m4lBcf_irKfcMo8D7rmVf3mKiD0hViDLhNQHStH1IWqYRm7COl09hzdk9uBXgL0EHp-o_vFcG6melyanIjpI Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Project-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ed92c60cf9644b5ba5cefd2e92df3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Tenant-Id: 0ed92c60cf9644b5ba5cefd2e92df3e0 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-93672654 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:53 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:28:53 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:28:53 user devstack@n-api.service[72345]: X-User-Id: b724859b7dcd4fd29f17bbf991e9f6d4 Apr 11 18:28:53 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-93672654-project-member Apr 11 18:28:53 user devstack@n-api.service[72345]: method: > Apr 11 18:28:53 user devstack@n-api.service[72345]: exception: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72345]: action_args: {'id': '582e004b-a2f3-4397-9ccb-d23f5724ebe1'} Apr 11 18:28:53 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. Apr 11 18:28:53 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:28:53 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Returning 404 to user: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:28:53 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-322e078e-4851-4035-ba20-ce6a71a1dfb0 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1" status: 404 len: 111 microversion: 2.20 time: 0.044297 Apr 11 18:28:53 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 297/894] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:28:53 2023] GET /compute/v2.1/servers/582e004b-a2f3-4397-9ccb-d23f5724ebe1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:29:07 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:07 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:07 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-75311c8e-ef4e-4867-b0a1-d859ca875bb5 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: .version_select at 0x7fadb95c6170>, body: {"keypair": {"name": "tempest-keypair-1464858302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs3E53rMZKipajWGRqQNLsyHSKcE1Cs3luZCWsL04LhnfSC2/CNpZVWRwyQLpg30e3tVrpCk5563xjYj4TS9PlR6KzO1JX6F3Xn3TwcxmVfPqms9QO0aJW9BV6zucfu+g=="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:07 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-75311c8e-ef4e-4867-b0a1-d859ca875bb5 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:29:07 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-75311c8e-ef4e-4867-b0a1-d859ca875bb5 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:29:07 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-75311c8e-ef4e-4867-b0a1-d859ca875bb5 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167044 Apr 11 18:29:07 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 303/895] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:29:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1018724989", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3f8e56ff-5c92-4875-898e-96328ce084d7"}], "security_groups": [{"name": "tempest-securitygroup--1053424104"}], "key_name": "tempest-keypair-1464858302", "user_data": "}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] validate_networks() for [('3f8e56ff-5c92-4875-898e-96328ce084d7', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:29:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:29:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.565851 Apr 11 18:29:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 296/896] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:29:09 2023] POST /compute/v2.1/servers => generated 400 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:29:10 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-27565635-5b43-4e47-a4ed-46bc5dd4675f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:29:10 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-27565635-5b43-4e47-a4ed-46bc5dd4675f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:29:10 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:10 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=5 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:10 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-27565635-5b43-4e47-a4ed-46bc5dd4675f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:10 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-27565635-5b43-4e47-a4ed-46bc5dd4675f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 200 len: 1236 microversion: 2.1 time: 0.073874 Apr 11 18:29:10 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 298/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:29:10 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:29:12 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:12 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Creating event network-changed:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:29:12 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028104 Apr 11 18:29:12 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 304/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:14 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:14 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a3fc89c1-3524-4bf5-864c-0a46beb0b2c2 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1552 microversion: 2.1 time: 0.173138 Apr 11 18:29:14 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 297/899] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:29:14 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:29:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "name": "network-vif-plugged", "status": "completed", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:14 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Creating event network-vif-plugged:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:29:14 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045644 Apr 11 18:29:14 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 299/900] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-966866756", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "c65d6737-91d9-40cd-a03c-f8049dc621fe"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:15 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] validate_networks() for [('c65d6737-91d9-40cd-a03c-f8049dc621fe', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for user fde784625fda4447afc0b8e9bd0983a3 and project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:29:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:29:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.651070 Apr 11 18:29:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 305/901] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:29:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:29:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:29:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:29:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-bda2bb86-f7f3-4bad-bcd0-361905acd56d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 200 len: 1394 microversion: 2.87 time: 0.083264 Apr 11 18:29:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 298/902] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:29:16 2023] GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 1394 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:29:16 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "name": "network-vif-plugged", "status": "completed", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Creating event network-vif-plugged:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:29:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Apr 11 18:29:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 300/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Creating event network-changed:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:29:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036978 Apr 11 18:29:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 306/904] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:21 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "name": "network-vif-plugged", "status": "completed", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:21 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:21 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Creating event network-vif-plugged:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:29:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051174 Apr 11 18:29:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 299/905] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:23 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:23 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "name": "network-vif-plugged", "status": "completed", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:29:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Creating event network-vif-plugged:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:29:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043767 Apr 11 18:29:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 301/906] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=10 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:29:27 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:29:27 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-290e325a-1c54-4262-840f-203ef0275786 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 200 len: 1443 microversion: 2.1 time: 0.151336 Apr 11 18:29:27 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 307/907] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:29:27 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=11 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:00 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:00 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e995de4b-10d5-41e1-8de2-ec52c4e13b93 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 200 len: 1545 microversion: 2.1 time: 0.169284 Apr 11 18:30:00 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 300/908] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:30:00 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 1545 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=10 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b2a1d125-db04-436f-9ff9-1650ea2436b8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 200 len: 1688 microversion: 2.87 time: 0.190080 Apr 11 18:30:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 302/909] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:30:06 2023] GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action" status: 204 len: 0 microversion: 2.1 time: 0.084944 Apr 11 18:30:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 308/910] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:30:14 2023] POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:14 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:14 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c8d2e9d6-4725-45c3-8ea1-8182561a2628 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1552 microversion: 2.1 time: 0.170357 Apr 11 18:30:14 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 301/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:30:14 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:27 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-14a7eb76-dd7c-40ac-b2da-222b8c567dd1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 200 len: 1443 microversion: 2.1 time: 0.154958 Apr 11 18:30:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 303/912] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:30:27 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Creating event network-changed:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:30:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037184 Apr 11 18:30:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 309/913] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:30:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 204 len: 0 microversion: 2.1 time: 0.128632 Apr 11 18:30:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 302/914] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:30:29 2023] DELETE /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:29 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:30:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-75ddd531-b66e-45b3-89c0-fcc02d27d2c4 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 200 len: 1449 microversion: 2.1 time: 0.241509 Apr 11 18:30:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 304/915] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:30:29 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 1449 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:30:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "name": "network-vif-unplugged", "status": "completed", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:30:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Creating event network-vif-unplugged:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:30:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028115 Apr 11 18:30:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 310/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:30:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "name": "network-vif-deleted", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:30:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] Creating event network-vif-deleted:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:30:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Apr 11 18:30:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 303/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:30:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:30:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d0bb76-375f-432e-acc9-97a5becbca95", "name": "network-vif-plugged", "status": "completed", "tag": "59743a6c-f7b8-42a5-95a1-97101a45ce4c"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:30:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:30:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:30:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:30:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Creating event network-vif-plugged:59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance 65d0bb76-375f-432e-acc9-97a5becbca95 on user Apr 11 18:30:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030995 Apr 11 18:30:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 305/918] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6fdef12e-0a96-4498-9660-8efd51d96f21 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.138518 Apr 11 18:31:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 311/919] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:31:00 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-interface => generated 282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=14 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:01 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Creating event network-changed:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:01 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088771 Apr 11 18:31:01 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 304/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1d5b6390-3fea-4724-b506-431f236f4b8c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/ips" status: 200 len: 107 microversion: 2.1 time: 0.045595 Apr 11 18:31:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:31:01 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a2b3d37-c5ab-4df4-9135-e366c9c642dc"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:02 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:02 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257704 Apr 11 18:31:02 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 312/922] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:31:02 2023] POST /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:04 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d5f409a0-d11a-49f1-a461-8efc38a18395 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1544 microversion: 2.1 time: 0.196214 Apr 11 18:31:04 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 305/923] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:31:04 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-489902012"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3/action" status: 202 len: 52 microversion: 2.87 time: 0.778737 Apr 11 18:31:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 307/924] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:31:06 2023] POST /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3/action => generated 52 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 18:31:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-df0e4f1b-1485-4423-86f7-1fdeabe7ccea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: .version_select at 0x7fadb95c6320>, body: {"keypair": {"name": "tempest-keypair-112673211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBneTmEZ0pN2UQnlNCBoG+jleLJbnM30xGDCQgQfFmgvBn8qq7xxOcd4Rerr6G7VYjxhDiFUwZai0A5JVSxZi4f41Ai9YF85rTqqnr5mQV8CI8ukRDiSMQwiZ6Clpof+DQ=="}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:09 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-df0e4f1b-1485-4423-86f7-1fdeabe7ccea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:31:09 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-df0e4f1b-1485-4423-86f7-1fdeabe7ccea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:31:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-df0e4f1b-1485-4423-86f7-1fdeabe7ccea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047879 Apr 11 18:31:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 313/925] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:31:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1458079097", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3f8e56ff-5c92-4875-898e-96328ce084d7"}], "security_groups": [{"name": "tempest-securitygroup--482366623"}], "key_name": "tempest-keypair-112673211", "user_data": "}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:11 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] validate_networks() for [('3f8e56ff-5c92-4875-898e-96328ce084d7', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:31:12 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:31:12 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.770223 Apr 11 18:31:12 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 306/926] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:31:11 2023] POST /compute/v2.1/servers => generated 399 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:31:12 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e23522e5-12c5-439f-b6da-5e77f59114e6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:12 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-e23522e5-12c5-439f-b6da-5e77f59114e6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:12 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-e23522e5-12c5-439f-b6da-5e77f59114e6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:12 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e23522e5-12c5-439f-b6da-5e77f59114e6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 200 len: 1235 microversion: 2.1 time: 0.083480 Apr 11 18:31:12 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 308/927] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:31:12 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:14 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:14 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8d9403ad-68f1-4cfc-867c-cf64ea449f2e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 200 len: 1688 microversion: 2.87 time: 0.161210 Apr 11 18:31:14 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 314/928] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:31:14 2023] GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:31:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:15 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Creating event network-changed:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:31:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100460 Apr 11 18:31:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 307/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "name": "network-vif-plugged", "status": "completed", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:17 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Creating event network-vif-plugged:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:31:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065379 Apr 11 18:31:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 309/930] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "name": "network-vif-plugged", "status": "completed", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:19 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Creating event network-vif-plugged:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:31:19 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Apr 11 18:31:19 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 315/931] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:31:20 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 HTTP/1.1 Apr 11 18:31:20 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:31:20 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:31:20 user devstack@n-api.service[72343]: Connection: close Apr 11 18:31:20 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:31:20 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:31:20 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:31:20 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:31:20 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:31:20 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:31:20 user devstack@n-api.service[72343]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:31:20 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:31:20 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:31:20 user devstack@n-api.service[72343]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:31:20 user devstack@n-api.service[72343]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:31:20 user devstack@n-api.service[72343]: method: > Apr 11 18:31:20 user devstack@n-api.service[72343]: exception: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:31:20 user devstack@n-api.service[72343]: action_args: {'id': '65d0bb76-375f-432e-acc9-97a5becbca95'} Apr 11 18:31:20 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:31:20 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:31:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:31:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-174bf2fa-7a9e-4adc-973d-2024609f5458 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 404 len: 111 microversion: 2.1 time: 0.175430 Apr 11 18:31:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 308/932] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:31:20 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-416829470", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1952119330", "security_groups": [{"name": "tempest-secgroup-smoke-1961961393"}], "block_device_mapping_v2": [{"uuid": "6709e067-9e56-479d-9981-a93cbfbf9296", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:31:20 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6709e067-9e56-479d-9981-a93cbfbf9296',volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:31:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.785256 Apr 11 18:31:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 310/933] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:31:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:31:21 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-d5194422-3c22-43ff-88a2-e446c1a957b5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:31:21 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-d5194422-3c22-43ff-88a2-e446c1a957b5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:31:21 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-d5194422-3c22-43ff-88a2-e446c1a957b5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:31:21 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-d5194422-3c22-43ff-88a2-e446c1a957b5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 200 len: 1089 microversion: 2.1 time: 0.073776 Apr 11 18:31:21 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 316/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:31:21 2023] GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:24 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Creating event network-changed:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:31:24 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039239 Apr 11 18:31:24 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 309/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "name": "network-vif-plugged", "status": "completed", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Creating event network-vif-plugged:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:31:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095326 Apr 11 18:31:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 311/936] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "name": "network-vif-plugged", "status": "completed", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:31:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:31:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Creating event network-vif-plugged:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:31:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118169 Apr 11 18:31:32 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 317/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=16 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:02 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-72e1d2a6-315c-4271-8871-b8a88c579ea0 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 200 len: 1543 microversion: 2.1 time: 0.190210 Apr 11 18:32:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 310/938] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:32:02 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 1543 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=8 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:05 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-380387df-d292-4417-9a58-3aa54696a29d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1544 microversion: 2.1 time: 0.380205 Apr 11 18:32:05 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 312/939] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:32:04 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1544 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action" status: 200 len: 28493 microversion: 2.1 time: 0.269315 Apr 11 18:32:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 318/940] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 18:32:05 2023] POST /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a/action => generated 28493 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:05 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-73711187-e2f8-4499-bfcf-c87f9ce8ef2c tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 200 len: 1537 microversion: 2.1 time: 0.157615 Apr 11 18:32:05 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 311/941] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:32:05 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:11 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0bb23b81-1d44-4174-a0d6-170863f95047 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 200 len: 1442 microversion: 2.1 time: 0.144067 Apr 11 18:32:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 313/942] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:32:11 2023] GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 1442 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1226293529", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "destination_type": "volume"}], "networks": [{"uuid": "c65d6737-91d9-40cd-a03c-f8049dc621fe"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] validate_networks() for [('c65d6737-91d9-40cd-a03c-f8049dc621fe', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:32:14 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting quotas for user fde784625fda4447afc0b8e9bd0983a3 and project 62a254c432f54e1b8735e40af7063506. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:32:15 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:32:15 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:32:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.705421 Apr 11 18:32:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 319/943] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 18:32:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 18:32:15 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:32:15 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:32:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:15 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:32:15 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-55a1fc88-0628-4ac3-8711-8691d383d963 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1395 microversion: 2.87 time: 0.078279 Apr 11 18:32:15 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 312/944] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:32:15 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:32:17 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:32:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:17 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Creating event network-changed:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:32:17 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029268 Apr 11 18:32:17 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 314/945] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:32:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:32:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055613 Apr 11 18:32:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 320/946] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:32:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=10 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:32:31 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:32:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:32:31 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Apr 11 18:32:31 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 313/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:32:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=14 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:02 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0e034698-978b-4846-bfa3-42422788453a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.124386 Apr 11 18:33:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 315/948] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:33:02 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/os-interface => generated 282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Creating event network-changed:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:33:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038687 Apr 11 18:33:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 321/949] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2dd6d34e-333d-49b0-8318-87b0e60d8866 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/ips" status: 200 len: 107 microversion: 2.1 time: 0.048185 Apr 11 18:33:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 314/950] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:33:03 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/ips => generated 107 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a2b3d37-c5ab-4df4-9135-e366c9c642dc"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:33:03 user devstack@n-api.service[72345]: request: POST /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/os-volume_attachments HTTP/1.1 Apr 11 18:33:03 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:33:03 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:33:03 user devstack@n-api.service[72345]: Connection: close Apr 11 18:33:03 user devstack@n-api.service[72345]: Content-Length: 74 Apr 11 18:33:03 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:33:03 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:33:03 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:33:03 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:33:03 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:33:03 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:33:03 user devstack@n-api.service[72345]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:33:03 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:33:03 user devstack@n-api.service[72345]: Apr 11 18:33:03 user devstack@n-api.service[72345]: {"volumeAttachment": {"volumeId": "1a2b3d37-c5ab-4df4-9135-e366c9c642dc"}} Apr 11 18:33:03 user devstack@n-api.service[72345]: method: > Apr 11 18:33:03 user devstack@n-api.service[72345]: exception: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df Apr 11 18:33:03 user devstack@n-api.service[72345]: action_args: {'server_id': '8f7d2851-f711-4dc2-8166-133ea16c6a1b', 'body': {'volumeAttachment': {'volumeId': '1a2b3d37-c5ab-4df4-9135-e366c9c642dc'}}} Apr 11 18:33:03 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df Apr 11 18:33:03 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 400 to user: Invalid volume: volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc is already attached to instances: fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:33:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9bbaaeed-b494-429a-a4a7-05e5933425db tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102237 Apr 11 18:33:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 316/951] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:33:03 2023] POST /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:33:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 204 len: 0 microversion: 2.1 time: 0.131332 Apr 11 18:33:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 322/952] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:33:03 2023] DELETE /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:04 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:04 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "name": "network-vif-unplugged", "status": "completed", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:04 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-aa171357-dfc1-4184-84a5-73d047a7285f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 200 len: 1549 microversion: 2.1 time: 0.320534 Apr 11 18:33:04 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 315/953] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:03 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:33:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:04 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Creating event network-vif-unplugged:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:33:04 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112392 Apr 11 18:33:04 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 317/954] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "name": "network-vif-deleted", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] Creating event network-vif-deleted:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:33:05 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035019 Apr 11 18:33:05 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 316/955] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:05 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-27650890-4d0c-4c39-8b2c-ef810c33d10e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1767 microversion: 2.87 time: 0.218562 Apr 11 18:33:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 323/956] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:33:05 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1767 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:05 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:33:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 204 len: 0 microversion: 2.1 time: 0.125289 Apr 11 18:33:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 318/957] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:33:05 2023] DELETE /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7d2851-f711-4dc2-8166-133ea16c6a1b", "name": "network-vif-plugged", "status": "completed", "tag": "31692cb0-d0c2-44fc-aeb3-489ddb201839"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Creating event network-vif-plugged:31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b on user Apr 11 18:33:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Apr 11 18:33:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 324/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:06 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-1477428f-b888-4b68-9b6b-58fc16ce42fc tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 200 len: 1550 microversion: 2.1 time: 0.254093 Apr 11 18:33:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 317/959] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:06 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 1550 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:33:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-unplugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}, {"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-plugged", "status": "completed", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Creating event network-vif-unplugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:33:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Creating event network-vif-plugged:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:33:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029257 Apr 11 18:33:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 319/960] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:07 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d853cbf3-7869-416c-af88-0b01b498705a", "name": "network-vif-deleted", "tag": "d983c712-087e-4bf3-a5c9-98ae1eea11ac"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] Creating event network-vif-deleted:d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance d853cbf3-7869-416c-af88-0b01b498705a on user Apr 11 18:33:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028398 Apr 11 18:33:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 325/961] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:11 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-ea8d179f-a427-4b13-b0cb-e570102111fc tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 200 len: 1442 microversion: 2.1 time: 0.142752 Apr 11 18:33:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 318/962] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:11 2023] GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 1442 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:33:13 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:13 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Creating event network-changed:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:33:13 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027669 Apr 11 18:33:13 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 320/963] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1811728730", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1952119330", "security_groups": [{"name": "tempest-secgroup-smoke-1961961393"}], "block_device_mapping_v2": [{"uuid": "9b95fd41-cafd-4f63-b6cc-ba35d89aac56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b52e5445-d18f-4394-a52e-5927662174c0"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] validate_networks() for [('b52e5445-d18f-4394-a52e-5927662174c0', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting quotas for user 4c8825bcd5894c999412499de320dc00 and project e4f6857b777f4207b93d8c28aa39054b. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:33:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b95fd41-cafd-4f63-b6cc-ba35d89aac56',volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:33:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.683731 Apr 11 18:33:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 326/964] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:33:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:33:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-917606fd-3a9b-4c58-b7af-c365de54dcd6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-917606fd-3a9b-4c58-b7af-c365de54dcd6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-917606fd-3a9b-4c58-b7af-c365de54dcd6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-917606fd-3a9b-4c58-b7af-c365de54dcd6 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 200 len: 1090 microversion: 2.1 time: 0.064997 Apr 11 18:33:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 319/965] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:16 2023] GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 1090 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:33:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Creating event network-changed:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:33:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033080 Apr 11 18:33:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 321/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "name": "network-vif-plugged", "status": "completed", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Creating event network-vif-plugged:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:33:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Apr 11 18:33:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 327/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "name": "network-vif-plugged", "status": "completed", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=24 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=14 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:27 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Creating event network-vif-plugged:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:33:27 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039764 Apr 11 18:33:27 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 320/968] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:33:54 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b HTTP/1.1 Apr 11 18:33:54 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:33:54 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:33:54 user devstack@n-api.service[72345]: Connection: close Apr 11 18:33:54 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:33:54 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:33:54 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:33:54 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:33:54 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:33:54 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:33:54 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:33:54 user devstack@n-api.service[72345]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:33:54 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:33:54 user devstack@n-api.service[72345]: method: > Apr 11 18:33:54 user devstack@n-api.service[72345]: exception: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:33:54 user devstack@n-api.service[72345]: action_args: {'id': '8f7d2851-f711-4dc2-8166-133ea16c6a1b'} Apr 11 18:33:54 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:33:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:33:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-d87feff9-2200-45d2-95fa-d6b97cf3ebc3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 404 len: 111 microversion: 2.1 time: 0.040432 Apr 11 18:33:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:54 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:33:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-877dc2e4-c351-4de6-880c-fdac29b821ea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '.version_select at 0x7fadb95c69e0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-877dc2e4-c351-4de6-880c-fdac29b821ea tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112673211" status: 202 len: 0 microversion: 2.1 time: 0.034894 Apr 11 18:33:54 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 328/970] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:33:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112673211 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:55 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'services' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:33:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments/1a2b3d37-c5ab-4df4-9135-e366c9c642dc" status: 202 len: 0 microversion: 2.1 time: 0.192337 Apr 11 18:33:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 321/971] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:33:55 2023] DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments/1a2b3d37-c5ab-4df4-9135-e366c9c642dc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8124be2e-a5af-4d0b-b91c-cb5dae5bd08d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052022 Apr 11 18:33:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 323/972] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:33:55 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:33:56 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a HTTP/1.1 Apr 11 18:33:56 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:33:56 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:33:56 user devstack@n-api.service[72344]: Connection: close Apr 11 18:33:56 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:33:56 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:33:56 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:33:56 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:33:56 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72344]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:33:56 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72344]: method: > Apr 11 18:33:56 user devstack@n-api.service[72344]: exception: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72344]: action_args: {'id': 'd853cbf3-7869-416c-af88-0b01b498705a'} Apr 11 18:33:56 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:33:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2203409c-dd54-495c-9dc8-556da8f8ef8b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 404 len: 111 microversion: 2.1 time: 0.038980 Apr 11 18:33:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 329/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:56 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:33:56 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a HTTP/1.1 Apr 11 18:33:56 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:33:56 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:33:56 user devstack@n-api.service[72343]: Connection: close Apr 11 18:33:56 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:33:56 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:33:56 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:33:56 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:33:56 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72343]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:33:56 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72343]: method: > Apr 11 18:33:56 user devstack@n-api.service[72343]: exception: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72343]: action_args: {'id': 'd853cbf3-7869-416c-af88-0b01b498705a'} Apr 11 18:33:56 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:33:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-47fce699-ebf1-45d2-9e89-c21c69c4216f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 404 len: 111 microversion: 2.1 time: 0.033301 Apr 11 18:33:56 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 322/974] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:33:56 2023] DELETE /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:33:56 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a HTTP/1.1 Apr 11 18:33:56 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:33:56 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:33:56 user devstack@n-api.service[72345]: Connection: close Apr 11 18:33:56 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:33:56 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:33:56 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:33:56 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:33:56 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:33:56 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:33:56 user devstack@n-api.service[72345]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:33:56 user devstack@n-api.service[72345]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:33:56 user devstack@n-api.service[72345]: method: > Apr 11 18:33:56 user devstack@n-api.service[72345]: exception: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72345]: action_args: {'id': 'd853cbf3-7869-416c-af88-0b01b498705a'} Apr 11 18:33:56 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. Apr 11 18:33:56 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:33:56 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance d853cbf3-7869-416c-af88-0b01b498705a could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:33:56 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8cd0c242-045c-4a6c-9d93-e769ed079e73 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a" status: 404 len: 111 microversion: 2.1 time: 0.029670 Apr 11 18:33:56 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 324/975] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:56 2023] GET /compute/v2.1/servers/d853cbf3-7869-416c-af88-0b01b498705a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:33:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 204 len: 0 microversion: 2.1 time: 0.116629 Apr 11 18:33:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 330/976] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:33:56 2023] DELETE /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:56 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:33:56 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f559598b-e1b0-4af2-b96b-a7cbaf6a4bc5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 200 len: 1543 microversion: 2.1 time: 0.265903 Apr 11 18:33:56 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 323/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:33:56 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 1543 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:33:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "name": "network-vif-unplugged", "status": "completed", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Creating event network-vif-unplugged:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:33:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033799 Apr 11 18:33:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 325/978] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:33:59 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "name": "network-vif-plugged", "status": "completed", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}, {"server_uuid": "b2175ccc-960d-4eca-8e41-3783cf28410b", "name": "network-vif-deleted", "tag": "e146b0b2-5c30-4253-845d-2533c2961fcc"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:33:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:33:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:33:59 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:33:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Creating event network-vif-plugged:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:33:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Creating event network-vif-deleted:e146b0b2-5c30-4253-845d-2533c2961fcc for instance b2175ccc-960d-4eca-8e41-3783cf28410b on user Apr 11 18:33:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031815 Apr 11 18:33:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 331/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "909d8608-beaa-4443-b4e2-94783ce5dadb"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:05 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'flavor' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:34:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a/action" status: 200 len: 29 microversion: 2.87 time: 0.501934 Apr 11 18:34:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 324/980] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:34:05 2023] POST /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a/action => generated 29 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:06 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f4a3ff32-cf58-42d7-a7cf-abf50ab61352 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1773 microversion: 2.87 time: 0.282774 Apr 11 18:34:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 326/981] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:34:06 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1773 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:06 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:06 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3cc87250-593d-4103-aeed-21b4d03c5197 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 200 len: 1443 microversion: 2.1 time: 0.186660 Apr 11 18:34:06 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 332/982] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:34:06 2023] GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 1443 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:34:07 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Creating event network-vif-unplugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031649 Apr 11 18:34:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 325/983] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Creating event network-vif-unplugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034475 Apr 11 18:34:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 327/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:09 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Apr 11 18:34:11 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 333/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:34:13 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038671 Apr 11 18:34:13 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 326/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=14 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=20 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:45 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-bd6fe192-dc4f-485b-b3d6-203b163b04e7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122991 Apr 11 18:34:45 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 328/987] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:34:45 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:46 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:34:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 204 len: 0 microversion: 2.1 time: 0.155497 Apr 11 18:34:46 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 334/988] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:34:46 2023] DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:46 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-cb8688c0-e8da-4286-a8cf-203660ea960c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 200 len: 1669 microversion: 2.1 time: 0.182047 Apr 11 18:34:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 327/989] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:34:46 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:34:46 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "name": "network-vif-unplugged", "status": "completed", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:46 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Creating event network-vif-unplugged:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:34:46 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028328 Apr 11 18:34:46 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 329/990] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:34:47 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b HTTP/1.1 Apr 11 18:34:47 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:34:47 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:34:47 user devstack@n-api.service[72344]: Connection: close Apr 11 18:34:47 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:34:47 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:34:47 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:34:47 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:34:47 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:47 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:34:47 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:34:47 user devstack@n-api.service[72344]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:34:47 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:47 user devstack@n-api.service[72344]: method: > Apr 11 18:34:47 user devstack@n-api.service[72344]: exception: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. Apr 11 18:34:47 user devstack@n-api.service[72344]: action_args: {'id': 'b2175ccc-960d-4eca-8e41-3783cf28410b'} Apr 11 18:34:47 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. Apr 11 18:34:47 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance b2175ccc-960d-4eca-8e41-3783cf28410b could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:34:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3ab3a21e-8c62-4261-bef5-c71ce7f521a6 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b" status: 404 len: 111 microversion: 2.1 time: 0.041909 Apr 11 18:34:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 335/991] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:34:47 2023] GET /compute/v2.1/servers/b2175ccc-960d-4eca-8e41-3783cf28410b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:34:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "name": "network-vif-deleted", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] Creating event network-vif-deleted:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:34:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031169 Apr 11 18:34:48 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 328/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf10cce-a01c-4e3f-8212-a2a0d42713df", "name": "network-vif-plugged", "status": "completed", "tag": "4c35126a-2ca0-4982-864d-7006fbc34a4d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:34:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Creating event network-vif-plugged:4c35126a-2ca0-4982-864d-7006fbc34a4d for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df on user Apr 11 18:34:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040942 Apr 11 18:34:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 330/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:34:49 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 HTTP/1.1 Apr 11 18:34:49 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:34:49 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:34:49 user devstack@n-api.service[72344]: Connection: close Apr 11 18:34:49 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:34:49 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:34:49 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:34:49 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:34:49 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:49 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:34:49 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:34:49 user devstack@n-api.service[72344]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:34:49 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:49 user devstack@n-api.service[72344]: method: > Apr 11 18:34:49 user devstack@n-api.service[72344]: exception: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72344]: action_args: {'id': '1adc9f1d-cc32-446e-9ffc-5fada2383164'} Apr 11 18:34:49 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:34:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a9ad0005-c91f-484a-be86-141ca9c0e289 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 404 len: 111 microversion: 2.1 time: 0.036918 Apr 11 18:34:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 336/994] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:34:49 2023] DELETE /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HTTP exception thrown: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Request method failure captured: Apr 11 18:34:49 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 HTTP/1.1 Apr 11 18:34:49 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:34:49 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:34:49 user devstack@n-api.service[72343]: Connection: close Apr 11 18:34:49 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:34:49 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:34:49 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:34:49 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:34:49 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaJ8VCIgxwVHP9OA-JZm35PdI5-tpl6WaRRjGAncshwER9cNOKlGcdWbZx4eekHefGs7O-0N0Kg537vuxtVJm0gDXUwrAI3VkYObVEfkX16AcfdJvhMYdaKihiFHJTuOJsjDDqOKRTmuHJqJxu2zHpBIxuL5p3j23i-GNfflK7ZeabA Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Project-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e49c5486b65e4d3eaab7c35fe84ac9c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Tenant-Id: e49c5486b65e4d3eaab7c35fe84ac9c9 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerActionsTestJSON-1277136387 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-User: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:49 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:34:49 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:34:49 user devstack@n-api.service[72343]: X-User-Id: 5ea51d683a9e45529a4eafc2359be9c8 Apr 11 18:34:49 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerActionsTestJSON-1277136387-project-member Apr 11 18:34:49 user devstack@n-api.service[72343]: method: > Apr 11 18:34:49 user devstack@n-api.service[72343]: exception: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72343]: action_args: {'id': '1adc9f1d-cc32-446e-9ffc-5fada2383164'} Apr 11 18:34:49 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. Apr 11 18:34:49 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:34:49 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Returning 404 to user: Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:34:49 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3fca4b28-c4d4-46b7-9d10-df72b1ed2c22 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164" status: 404 len: 111 microversion: 2.1 time: 0.035303 Apr 11 18:34:49 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 329/995] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:34:49 2023] GET /compute/v2.1/servers/1adc9f1d-cc32-446e-9ffc-5fada2383164 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:34:49 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ff98256c-f76a-4dbc-ab5e-28821fddd59d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Calling method '.version_select at 0x7fadb9a3bac0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:49 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ff98256c-f76a-4dbc-ab5e-28821fddd59d tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-154558437" status: 202 len: 0 microversion: 2.1 time: 0.021864 Apr 11 18:34:49 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 331/996] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:34:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-154558437 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:56 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:34:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-becfdee0-a3fb-4c9b-bddf-823afdfb8bd8 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1753 microversion: 2.87 time: 0.279140 Apr 11 18:34:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 337/997] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:34:56 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1753 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:35:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:01 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=10 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1438556823", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] validate_networks() for [('84f8f0e1-c59e-49b9-8a72-ef9903971259', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting quotas for project 423994357c024575acae85fb885f4069. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting quotas for user 423f3e46d47448fb880c9eeb1281565a and project 423994357c024575acae85fb885f4069. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:35:02 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:35:02 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.682423 Apr 11 18:35:02 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 330/998] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:35:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:35:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=10 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:02 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:02 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b610e3f6-4984-4a0f-b128-6d17e1be5f9c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:02 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b610e3f6-4984-4a0f-b128-6d17e1be5f9c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:02 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-b610e3f6-4984-4a0f-b128-6d17e1be5f9c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:02 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b610e3f6-4984-4a0f-b128-6d17e1be5f9c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1211 microversion: 2.1 time: 0.109991 Apr 11 18:35:02 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 332/999] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:02 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:35:05 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:05 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Creating event network-changed:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:35:05 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Apr 11 18:35:05 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 338/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:07 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:07 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-9f4e2f83-c6af-43ac-8bd0-01341bb4e392 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 200 len: 1443 microversion: 2.1 time: 0.231783 Apr 11 18:35:07 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 331/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:07 2023] GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 1443 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:35:07 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:07 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:35:07 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037405 Apr 11 18:35:07 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 333/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Creating event network-changed:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:35:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031607 Apr 11 18:35:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 339/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:35:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051769 Apr 11 18:35:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 332/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:35:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Creating event network-changed:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:35:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049534 Apr 11 18:35:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 340/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 204 len: 0 microversion: 2.1 time: 0.117468 Apr 11 18:35:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:35:09 2023] DELETE /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:10 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-0671a044-bc02-42d6-ab4e-acf4e3259c1b tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 200 len: 1568 microversion: 2.1 time: 0.316001 Apr 11 18:35:10 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 333/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:09 2023] GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:35:11 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "name": "network-vif-unplugged", "status": "completed", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}, {"server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "name": "network-vif-plugged", "status": "completed", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:11 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Creating event network-vif-unplugged:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:35:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Creating event network-vif-plugged:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:35:11 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036295 Apr 11 18:35:11 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 341/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:11 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e532c0-b6d3-49c5-8ee2-371d1423abda", "name": "network-vif-deleted", "tag": "95038301-4dc6-4a03-ad63-c17301be86c7"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:11 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] Creating event network-vif-deleted:95038301-4dc6-4a03-ad63-c17301be86c7 for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda on user Apr 11 18:35:11 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035884 Apr 11 18:35:11 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 335/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=16 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:36 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:35:36 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df HTTP/1.1 Apr 11 18:35:36 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:35:36 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:35:36 user devstack@n-api.service[72343]: Connection: close Apr 11 18:35:36 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:35:36 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:35:36 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:35:36 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:35:36 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:35:36 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:35:36 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:35:36 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:35:36 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:35:36 user devstack@n-api.service[72343]: method: > Apr 11 18:35:36 user devstack@n-api.service[72343]: exception: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:35:36 user devstack@n-api.service[72343]: action_args: {'id': 'fbf10cce-a01c-4e3f-8212-a2a0d42713df'} Apr 11 18:35:36 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:35:36 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:35:36 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:35:36 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6f99e919-aa97-4c8e-bd3f-e29ea1dd3c59 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 404 len: 111 microversion: 2.1 time: 0.037966 Apr 11 18:35:36 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 334/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:36 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:35:36 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e5e55b31-b188-4dc3-99d0-d2849745a23c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '.version_select at 0x7fadb9bccdc0>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:36 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:36 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e5e55b31-b188-4dc3-99d0-d2849745a23c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464858302" status: 202 len: 0 microversion: 2.1 time: 0.030983 Apr 11 18:35:36 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 342/1011] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:35:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464858302 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-59ffdd22-f600-4191-a445-48c99496bc5d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: .version_select at 0x7fadb9798160>, body: {"keypair": {"name": "tempest-keypair-2138755154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3IjFSFuUivBNpfQF2rtSYTbcXASfl6aabS3bgmO/p7n8BH94qlrQ3XnifiKs1PEA2gzpUr4NAP6XOtmsOqapxYUVA4fW/2Q1ESbSxPS1dDRrkl21GGjOby2LesnRQWgA=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-59ffdd22-f600-4191-a445-48c99496bc5d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:35:37 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-59ffdd22-f600-4191-a445-48c99496bc5d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:35:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-59ffdd22-f600-4191-a445-48c99496bc5d tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056132 Apr 11 18:35:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 336/1012] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:35:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-328545184", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3f8e56ff-5c92-4875-898e-96328ce084d7"}], "security_groups": [{"name": "tempest-securitygroup--1430214723"}], "key_name": "tempest-keypair-2138755154", "user_data": "}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] validate_networks() for [('3f8e56ff-5c92-4875-898e-96328ce084d7', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:35:39 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:35:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.571712 Apr 11 18:35:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 335/1013] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:35:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:35:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6a52aac9-79dc-47d2-a655-6a0200bd9f76 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:39 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6a52aac9-79dc-47d2-a655-6a0200bd9f76 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:39 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6a52aac9-79dc-47d2-a655-6a0200bd9f76 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6a52aac9-79dc-47d2-a655-6a0200bd9f76 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 200 len: 1235 microversion: 2.1 time: 0.072589 Apr 11 18:35:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 343/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:39 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 1235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:35:42 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Creating event network-changed:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:35:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029034 Apr 11 18:35:42 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 337/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:44 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "name": "network-vif-plugged", "status": "completed", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:44 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Creating event network-vif-plugged:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:35:44 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139066 Apr 11 18:35:44 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 336/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "name": "network-vif-plugged", "status": "completed", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Creating event network-vif-plugged:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:35:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030507 Apr 11 18:35:46 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 344/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:52 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:52 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-03b2f9af-98af-44fd-86ad-e271d4a6af75 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1495 microversion: 2.1 time: 0.240973 Apr 11 18:35:52 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:35:52 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "POST /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a/action" status: 202 len: 0 microversion: 2.87 time: 0.097053 Apr 11 18:35:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 337/1019] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 18:35:56 2023] POST /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:57 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:35:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3e5bc1b3-974d-43da-accb-c9fd88bc179c tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1761 microversion: 2.87 time: 0.180650 Apr 11 18:35:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 345/1020] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:35:57 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:35:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Creating event network-vif-unplugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030832 Apr 11 18:35:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 339/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:35:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}, {"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:35:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:35:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:35:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-unplugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:35:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.035012 Apr 11 18:35:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 338/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:35:59 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:36:00 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda HTTP/1.1 Apr 11 18:36:00 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:36:00 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:36:00 user devstack@n-api.service[72344]: Connection: close Apr 11 18:36:00 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:36:00 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:36:00 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:36:00 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:36:00 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:00 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:00 user devstack@n-api.service[72344]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:00 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:36:00 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:36:00 user devstack@n-api.service[72344]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:36:00 user devstack@n-api.service[72344]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:00 user devstack@n-api.service[72344]: method: > Apr 11 18:36:00 user devstack@n-api.service[72344]: exception: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. Apr 11 18:36:00 user devstack@n-api.service[72344]: action_args: {'id': '73e532c0-b6d3-49c5-8ee2-371d1423abda'} Apr 11 18:36:00 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. Apr 11 18:36:00 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:36:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:36:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-406a71c5-647d-4310-b573-95fc9bf759f1 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda" status: 404 len: 111 microversion: 2.1 time: 0.031512 Apr 11 18:36:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 346/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:00 2023] GET /compute/v2.1/servers/73e532c0-b6d3-49c5-8ee2-371d1423abda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:36:01 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:01 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:36:01 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Apr 11 18:36:01 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 340/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:03 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:36:03 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:03 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Creating event network-changed:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:36:03 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097648 Apr 11 18:36:03 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 347/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:36:03 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 204 len: 0 microversion: 2.1 time: 0.135127 Apr 11 18:36:03 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 339/1026] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:36:03 2023] DELETE /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:03 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:03 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-e5f56ef2-2b89-4c83-a96d-edf9d16dc364 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 200 len: 1566 microversion: 2.1 time: 0.165667 Apr 11 18:36:03 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:03 2023] GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:36:04 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "name": "network-vif-unplugged", "status": "completed", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:04 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Creating event network-vif-unplugged:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:36:04 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039232 Apr 11 18:36:04 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 348/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:36:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "name": "network-vif-plugged", "status": "completed", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}, {"server_uuid": "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1", "name": "network-vif-deleted", "tag": "15811309-acaa-4e5f-8b93-0f4511612c79"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Creating event network-vif-plugged:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:36:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Creating event network-vif-deleted:15811309-acaa-4e5f-8b93-0f4511612c79 for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 on user Apr 11 18:36:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032521 Apr 11 18:36:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 340/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=8 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=16 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:29 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1a99c20d-ca41-4702-ad15-0bec0f3792ba tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 200 len: 1544 microversion: 2.1 time: 0.166621 Apr 11 18:36:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:29 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=10 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:47 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6c497c06-863e-4413-b81a-ed2c5d42ad25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1767 microversion: 2.87 time: 0.233777 Apr 11 18:36:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 349/1031] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:36:47 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1767 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:36:53 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:53 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:53 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-508320532", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:53 user devstack@n-api.service[72343]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] validate_networks() for [('84f8f0e1-c59e-49b9-8a72-ef9903971259', None, None, None, None, None)] {{(pid=72343) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:36:54 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 HTTP/1.1 Apr 11 18:36:54 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:36:54 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:36:54 user devstack@n-api.service[72345]: Connection: close Apr 11 18:36:54 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:36:54 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:36:54 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:36:54 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:36:54 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72345]: method: > Apr 11 18:36:54 user devstack@n-api.service[72345]: exception: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: action_args: {'id': '91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1'} Apr 11 18:36:54 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:36:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-45ea014f-7585-4ce0-bd48-f70253e7b4cb tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" status: 404 len: 111 microversion: 2.1 time: 0.140119 Apr 11 18:36:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 343/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:54 2023] GET /compute/v2.1/servers/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image limits 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image pref 0:0:0 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting quotas for project 423994357c024575acae85fb885f4069. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting quotas for user 423f3e46d47448fb880c9eeb1281565a and project 423994357c024575acae85fb885f4069. Resources: {'instances', 'cores', 'ram'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Going to run 1 instances... {{(pid=72343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:36:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.293873 Apr 11 18:36:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 341/1033] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:36:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:36:54 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-b32f8b7f-8914-4c3d-980c-faac0a947487 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:54 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-b32f8b7f-8914-4c3d-980c-faac0a947487 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:54 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-b32f8b7f-8914-4c3d-980c-faac0a947487 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:36:54 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-b32f8b7f-8914-4c3d-980c-faac0a947487 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 200 len: 1210 microversion: 2.1 time: 0.096596 Apr 11 18:36:54 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 350/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:54 2023] GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:36:54 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 HTTP/1.1 Apr 11 18:36:54 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:36:54 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:36:54 user devstack@n-api.service[72345]: Connection: close Apr 11 18:36:54 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:36:54 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:36:54 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:36:54 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:36:54 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:36:54 user devstack@n-api.service[72345]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72345]: method: > Apr 11 18:36:54 user devstack@n-api.service[72345]: exception: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: action_args: {'id': '65d0bb76-375f-432e-acc9-97a5becbca95'} Apr 11 18:36:54 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:36:54 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7ff98972-985e-40d5-bfb3-5f103a04e838 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 404 len: 111 microversion: 2.1 time: 0.026764 Apr 11 18:36:54 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 344/1035] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:36:54 2023] DELETE /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HTTP exception thrown: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Request method failure captured: Apr 11 18:36:54 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 HTTP/1.1 Apr 11 18:36:54 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:36:54 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:36:54 user devstack@n-api.service[72343]: Connection: close Apr 11 18:36:54 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:36:54 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:36:54 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:36:54 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:36:54 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaTX-neaDSHAAE6n8P1aQqDIvRfb8-Vo7it-Ky86rTtxTv8w3_JiOh6YIfwP98qGU3u3QAe6-NmYCxXoL4PxSEs_PdOl1oAHf95tQiTLI3KknmTs019vNN4oPDZLOfN2uEtTYeKxw5g26vXhcRmEYha9U3uFa_cDRhe7-YBA035YdkY Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Project-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Project-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4f6857b777f4207b93d8c28aa39054b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Tenant: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Tenant-Id: e4f6857b777f4207b93d8c28aa39054b Apr 11 18:36:54 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-TestVolumeBootPattern-1768143130 Apr 11 18:36:54 user devstack@n-api.service[72343]: X-User: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:36:54 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:36:54 user devstack@n-api.service[72343]: X-User-Id: 4c8825bcd5894c999412499de320dc00 Apr 11 18:36:54 user devstack@n-api.service[72343]: X-User-Name: tempest-TestVolumeBootPattern-1768143130-project-member Apr 11 18:36:54 user devstack@n-api.service[72343]: method: > Apr 11 18:36:54 user devstack@n-api.service[72343]: exception: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72343]: action_args: {'id': '65d0bb76-375f-432e-acc9-97a5becbca95'} Apr 11 18:36:54 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. Apr 11 18:36:54 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:36:54 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Returning 404 to user: Instance 65d0bb76-375f-432e-acc9-97a5becbca95 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:36:54 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-59dd8fe4-8f5b-448c-8724-42c4a7777e62 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95" status: 404 len: 111 microversion: 2.1 time: 0.035977 Apr 11 18:36:54 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 342/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:36:54 2023] GET /compute/v2.1/servers/65d0bb76-375f-432e-acc9-97a5becbca95 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:36:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f7ae4f7a-dcc0-4544-b2c7-5db6b08535d9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Calling method '.version_select at 0x7fadb98a7c70>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:36:56 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f7ae4f7a-dcc0-4544-b2c7-5db6b08535d9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952119330" status: 202 len: 0 microversion: 2.1 time: 0.025566 Apr 11 18:36:56 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 351/1037] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 11 18:36:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1952119330 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:36:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Creating event network-changed:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:36:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087750 Apr 11 18:36:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 345/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:36:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "name": "network-vif-plugged", "status": "completed", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:36:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:36:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:36:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:36:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Creating event network-vif-plugged:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:36:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Apr 11 18:36:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 343/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:36:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:01 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:01 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "name": "network-vif-plugged", "status": "completed", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:01 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Creating event network-vif-plugged:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:37:01 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Apr 11 18:37:01 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 352/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-b23360d9-9aad-4441-bd57-c8d39d64112e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.115214 Apr 11 18:37:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 346/1041] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:37:29 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:30 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Creating event network-changed:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:37:30 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038968 Apr 11 18:37:30 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 344/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:30 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:30 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-105203ce-42ec-4a77-9754-544ce9252482 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/ips" status: 200 len: 107 microversion: 2.1 time: 0.051698 Apr 11 18:37:30 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 353/1043] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:37:30 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/ips => generated 107 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f31b39-56a1-452d-ae13-1175640a02c1"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271873 Apr 11 18:37:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 347/1044] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:37:32 2023] POST /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f31b39-56a1-452d-ae13-1175640a02c1"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 Apr 11 18:37:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:37:39 user devstack@n-api.service[72343]: request: POST /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments HTTP/1.1 Apr 11 18:37:39 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:37:39 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:37:39 user devstack@n-api.service[72343]: Connection: close Apr 11 18:37:39 user devstack@n-api.service[72343]: Content-Length: 74 Apr 11 18:37:39 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:37:39 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:37:39 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:37:39 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:37:39 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:37:39 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:37:39 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:37:39 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:37:39 user devstack@n-api.service[72343]: Apr 11 18:37:39 user devstack@n-api.service[72343]: {"volumeAttachment": {"volumeId": "71f31b39-56a1-452d-ae13-1175640a02c1"}} Apr 11 18:37:39 user devstack@n-api.service[72343]: method: > Apr 11 18:37:39 user devstack@n-api.service[72343]: exception: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 Apr 11 18:37:39 user devstack@n-api.service[72343]: action_args: {'server_id': '9a1efd21-1752-4335-841a-3669ac667247', 'body': {'volumeAttachment': {'volumeId': '71f31b39-56a1-452d-ae13-1175640a02c1'}}} Apr 11 18:37:39 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 Apr 11 18:37:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:37:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 400 to user: Invalid volume: volume 71f31b39-56a1-452d-ae13-1175640a02c1 is already attached to instances: 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:37:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-456256f6-d4b9-4019-8a2e-888c486a907e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108061 Apr 11 18:37:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 345/1045] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:37:38 2023] POST /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:39 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'services' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:37:39 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments/71f31b39-56a1-452d-ae13-1175640a02c1" status: 202 len: 0 microversion: 2.1 time: 0.156543 Apr 11 18:37:39 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 354/1046] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:37:39 2023] DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments/71f31b39-56a1-452d-ae13-1175640a02c1 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-699d300a-3b97-4e24-ad8c-a8b7419aea9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050375 Apr 11 18:37:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 348/1047] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:37:39 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:44 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:37:44 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6dcb004e-fdfb-42e6-b499-14a111723e1e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 200 len: 1493 microversion: 2.1 time: 0.284255 Apr 11 18:37:44 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 346/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:37:44 2023] GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 1493 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:48 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:37:48 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 204 len: 0 microversion: 2.87 time: 0.400434 Apr 11 18:37:48 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 355/1049] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:37:47 2023] DELETE /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:37:48 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:37:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-64f5a59d-7055-4cbd-887a-b3061292972a tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 200 len: 1773 microversion: 2.87 time: 0.177079 Apr 11 18:37:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 349/1050] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:37:48 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 1773 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:37:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Creating event network-vif-unplugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:37:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032010 Apr 11 18:37:48 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 347/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-deleted", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] Creating event network-vif-deleted:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:37:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028204 Apr 11 18:37:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 356/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:37:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a5f428-afe3-495a-80f5-b72b494a064a", "name": "network-vif-plugged", "status": "completed", "tag": "3d45cf5a-175a-4bca-9c73-119f3456643a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:37:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:37:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:37:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:37:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Creating event network-vif-plugged:3d45cf5a-175a-4bca-9c73-119f3456643a for instance 13a5f428-afe3-495a-80f5-b72b494a064a on user Apr 11 18:37:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Apr 11 18:37:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=16 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f336b2e0-4f76-4d23-818d-f61b61d33aa6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051775 Apr 11 18:38:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 348/1054] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:38:29 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:38:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 204 len: 0 microversion: 2.1 time: 0.126471 Apr 11 18:38:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 357/1055] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:38:29 2023] DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=12 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "name": "network-vif-unplugged", "status": "completed", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Creating event network-vif-unplugged:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:38:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028943 Apr 11 18:38:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 349/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:30 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:38:30 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-721bb136-d237-4a96-947b-b413227330f3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 200 len: 1669 microversion: 2.1 time: 0.356004 Apr 11 18:38:30 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 351/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:38:29 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:38:31 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "name": "network-vif-plugged", "status": "completed", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}, {"server_uuid": "9a1efd21-1752-4335-841a-3669ac667247", "name": "network-vif-deleted", "tag": "c667caf2-9e07-4a9e-a45f-d5f10898124a"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:31 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Creating event network-vif-plugged:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:38:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Creating event network-vif-deleted:c667caf2-9e07-4a9e-a45f-d5f10898124a for instance 9a1efd21-1752-4335-841a-3669ac667247 on user Apr 11 18:38:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031931 Apr 11 18:38:32 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 358/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HTTP exception thrown: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Request method failure captured: Apr 11 18:38:38 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a HTTP/1.1 Apr 11 18:38:38 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:38:38 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:38:38 user devstack@n-api.service[72343]: Connection: close Apr 11 18:38:38 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:38:38 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:38:38 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:38:38 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:38:38 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaT8TzUUFojRH6_oICimmQxJHoTCuva0i0gEMtrhQxGFlaOaTrF1WpybYF0kd4UBhKKiWhrTai1HP8RbTMRHhyxUvVodRS9bacYOgRcSC-XqWMeZCpJpvUZw1MGuFItFcWP-LLaWq-BTey0t6KiNM_GHaHweAYjRaQ_7j6idEGNchLY Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Project-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62a254c432f54e1b8735e40af7063506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Tenant-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:38:38 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:38:38 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:38:38 user devstack@n-api.service[72343]: X-User-Id: fde784625fda4447afc0b8e9bd0983a3 Apr 11 18:38:38 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:38:38 user devstack@n-api.service[72343]: method: > Apr 11 18:38:38 user devstack@n-api.service[72343]: exception: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. Apr 11 18:38:38 user devstack@n-api.service[72343]: action_args: {'id': '13a5f428-afe3-495a-80f5-b72b494a064a'} Apr 11 18:38:38 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. Apr 11 18:38:38 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Returning 404 to user: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:38:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-3d500188-52de-4ba6-b0c5-1da3a37a35e4 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a" status: 404 len: 111 microversion: 2.87 time: 0.037837 Apr 11 18:38:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 350/1059] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:38:38 2023] GET /compute/v2.1/servers/13a5f428-afe3-495a-80f5-b72b494a064a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:38:38 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 204 len: 0 microversion: 2.87 time: 0.116757 Apr 11 18:38:38 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 352/1060] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:38:38 2023] DELETE /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:38:38 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:38:38 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a0f3f360-624c-406f-9b10-65f683866218 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 200 len: 1694 microversion: 2.87 time: 0.170235 Apr 11 18:38:38 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 359/1061] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:38:38 2023] GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:38 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Creating event network-vif-unplugged:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:38:38 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031063 Apr 11 18:38:38 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 351/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "name": "network-vif-plugged", "status": "completed", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}, {"server_uuid": "91053286-2092-4540-a527-564c0cf78bd3", "name": "network-vif-deleted", "tag": "b5910cd2-0ef5-4d68-8dcf-5031c519642a"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Creating event network-vif-plugged:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:38:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Creating event network-vif-deleted:b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance 91053286-2092-4540-a527-564c0cf78bd3 on user Apr 11 18:38:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029576 Apr 11 18:38:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 353/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:44 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:38:45 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 204 len: 0 microversion: 2.1 time: 0.121376 Apr 11 18:38:45 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 360/1064] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:38:44 2023] DELETE /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:45 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:38:45 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-6e9b1b38-9b95-4009-95ce-03c767bcb48b tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 200 len: 1499 microversion: 2.1 time: 0.173488 Apr 11 18:38:45 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 352/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:38:45 2023] GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 1499 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:38:45 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "name": "network-vif-unplugged", "status": "completed", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:45 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:45 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Creating event network-vif-unplugged:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:38:45 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098221 Apr 11 18:38:45 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 354/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:46 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "name": "network-vif-deleted", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:46 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] Creating event network-vif-deleted:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:38:46 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037219 Apr 11 18:38:46 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 361/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:38:47 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cbcd59-6e6a-4950-8dae-738f3b7151ac", "name": "network-vif-plugged", "status": "completed", "tag": "223b0c54-2078-474a-96f4-91346bd1c1ff"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:38:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:38:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:38:47 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:38:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Creating event network-vif-plugged:223b0c54-2078-474a-96f4-91346bd1c1ff for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac on user Apr 11 18:38:47 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Apr 11 18:38:47 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 353/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:20 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:39:20 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 HTTP/1.1 Apr 11 18:39:20 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:39:20 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:39:20 user devstack@n-api.service[72345]: Connection: close Apr 11 18:39:20 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:39:20 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:39:20 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:39:20 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:39:20 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:39:20 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:39:20 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:39:20 user devstack@n-api.service[72345]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:39:20 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:39:20 user devstack@n-api.service[72345]: method: > Apr 11 18:39:20 user devstack@n-api.service[72345]: exception: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:39:20 user devstack@n-api.service[72345]: action_args: {'id': '9a1efd21-1752-4335-841a-3669ac667247'} Apr 11 18:39:20 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:39:20 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:39:20 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:39:20 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-5512c772-63e4-455f-b8cf-4adc8518c548 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 404 len: 111 microversion: 2.1 time: 0.038820 Apr 11 18:39:20 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 355/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:39:20 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:39:20 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-139e1237-f334-4559-a273-2598a6e15d9b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '.version_select at 0x7fadb97e2440>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-139e1237-f334-4559-a273-2598a6e15d9b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138755154" status: 202 len: 0 microversion: 2.1 time: 0.034638 Apr 11 18:39:20 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 362/1070] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 18:39:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138755154 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:39:20 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=20 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-19dd1e55-3b81-4c1b-b10c-f13acdde6590 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: .version_select at 0x7fadb940f910>, body: {"keypair": {"name": "tempest-keypair-994113133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqjtlcvFTOedW1tCltpV4NHM/VDv1sc6WJxf/MgmIAxMR51lkgELeDrhXhArbJRvpPAA3hKYozM1eCrhx/nOdUEQZ0SRgpKm30preBDIvt3XYB9AP5jIp2h9nLW+gtikQ=="}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:21 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-19dd1e55-3b81-4c1b-b10c-f13acdde6590 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:39:21 user devstack@n-api.service[72343]: DEBUG nova.quota [None req-19dd1e55-3b81-4c1b-b10c-f13acdde6590 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'key_pairs'} {{(pid=72343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:39:21 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-19dd1e55-3b81-4c1b-b10c-f13acdde6590 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105306 Apr 11 18:39:21 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 354/1071] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:39:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:22 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1928714156", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3f8e56ff-5c92-4875-898e-96328ce084d7"}], "security_groups": [{"name": "tempest-securitygroup--1408519855"}], "key_name": "tempest-keypair-994113133", "user_data": "}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:22 user devstack@n-api.service[72345]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] validate_networks() for [('3f8e56ff-5c92-4875-898e-96328ce084d7', None, None, None, None, None)] {{(pid=72345) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting quotas for user b91adf882c384c8c9e27a24a8c55b0a1 and project a92ba4ae3f244cfc9f3f0732ab9cc649. Resources: {'instances', 'cores', 'ram'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Going to run 1 instances... {{(pid=72345) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:39:23 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:39:23 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.694103 Apr 11 18:39:23 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 356/1072] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:39:22 2023] POST /compute/v2.1/servers => generated 400 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:39:23 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-1a93bf01-4b25-4d81-b3e0-17b0678d9040 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:23 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-1a93bf01-4b25-4d81-b3e0-17b0678d9040 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:23 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-1a93bf01-4b25-4d81-b3e0-17b0678d9040 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:39:23 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-1a93bf01-4b25-4d81-b3e0-17b0678d9040 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 200 len: 1235 microversion: 2.1 time: 0.074466 Apr 11 18:39:23 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 363/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:39:23 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:39:25 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:25 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Creating event network-changed:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:39:25 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046567 Apr 11 18:39:25 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 355/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:27 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "name": "network-vif-plugged", "status": "completed", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:27 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Creating event network-vif-plugged:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:39:27 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040258 Apr 11 18:39:27 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 357/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:28 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HTTP exception thrown: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. Apr 11 18:39:28 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Request method failure captured: Apr 11 18:39:28 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 HTTP/1.1 Apr 11 18:39:28 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:39:28 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:39:28 user devstack@n-api.service[72344]: Connection: close Apr 11 18:39:28 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:39:28 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:39:28 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:39:28 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:39:28 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaT8TzUUFojRH6_oICimmQxJHoTCuva0i0gEMtrhQxGFlaOaTrF1WpybYF0kd4UBhKKiWhrTai1HP8RbTMRHhyxUvVodRS9bacYOgRcSC-XqWMeZCpJpvUZw1MGuFItFcWP-LLaWq-BTey0t6KiNM_GHaHweAYjRaQ_7j6idEGNchLY Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Project-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62a254c432f54e1b8735e40af7063506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Tenant-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:39:28 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:39:28 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:39:28 user devstack@n-api.service[72344]: X-User-Id: fde784625fda4447afc0b8e9bd0983a3 Apr 11 18:39:28 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:39:28 user devstack@n-api.service[72344]: method: > Apr 11 18:39:28 user devstack@n-api.service[72344]: exception: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. Apr 11 18:39:28 user devstack@n-api.service[72344]: action_args: {'id': '91053286-2092-4540-a527-564c0cf78bd3'} Apr 11 18:39:28 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:39:28 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. Apr 11 18:39:29 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:39:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Returning 404 to user: Instance 91053286-2092-4540-a527-564c0cf78bd3 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:39:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3bece6d9-4109-42cd-8c3e-e9631f1da69e tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3" status: 404 len: 111 microversion: 2.87 time: 0.031331 Apr 11 18:39:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 364/1076] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:39:28 2023] GET /compute/v2.1/servers/91053286-2092-4540-a527-564c0cf78bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:39:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 204 len: 0 microversion: 2.87 time: 0.144651 Apr 11 18:39:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 356/1077] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:39:29 2023] DELETE /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:39:29 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:39:29 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-0c8e77dd-3886-4d0f-b7e3-3a4c95808d13 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 200 len: 1773 microversion: 2.87 time: 0.216814 Apr 11 18:39:29 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 358/1078] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:39:29 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 1773 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:39:29 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Creating event network-vif-unplugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:39:29 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031915 Apr 11 18:39:29 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 365/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "name": "network-vif-plugged", "status": "completed", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:29 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Creating event network-vif-plugged:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:39:29 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Apr 11 18:39:29 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 357/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:31 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-plugged", "status": "completed", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:31 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Creating event network-vif-plugged:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:39:31 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031467 Apr 11 18:39:31 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 359/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:32 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10824-ced0-49d5-934a-c509ab119cbf", "name": "network-vif-deleted", "tag": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:39:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:32 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] Creating event network-vif-deleted:d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance bef10824-ced0-49d5-934a-c509ab119cbf on user Apr 11 18:39:32 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040683 Apr 11 18:39:32 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 366/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] HTTP exception thrown: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:39:35 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac HTTP/1.1 Apr 11 18:39:35 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:39:35 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:39:35 user devstack@n-api.service[72343]: Connection: close Apr 11 18:39:35 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:39:35 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:39:35 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:39:35 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:39:35 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:39:35 user devstack@n-api.service[72343]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:39:35 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:39:35 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:39:35 user devstack@n-api.service[72343]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:39:35 user devstack@n-api.service[72343]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:39:35 user devstack@n-api.service[72343]: method: > Apr 11 18:39:35 user devstack@n-api.service[72343]: exception: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:39:35 user devstack@n-api.service[72343]: action_args: {'id': '73cbcd59-6e6a-4950-8dae-738f3b7151ac'} Apr 11 18:39:35 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:39:35 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:39:35 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 404 to user: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:39:35 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-b446474c-e1f4-4441-9b5d-fdbe6819b93c tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 404 len: 111 microversion: 2.1 time: 0.033423 Apr 11 18:39:35 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 358/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:39:35 2023] GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:39:35 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:39:35 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-397cdf97-4442-4878-af04-df0343563d12 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1495 microversion: 2.1 time: 0.185635 Apr 11 18:39:35 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 360/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:39:35 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1495 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:13 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:40:13 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-04defcb7-eeea-48d2-95fa-b9f16f901abc tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 200 len: 1544 microversion: 2.1 time: 0.224123 Apr 11 18:40:13 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 367/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:40:13 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 1544 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HTTP exception thrown: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Request method failure captured: Apr 11 18:40:19 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf HTTP/1.1 Apr 11 18:40:19 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:40:19 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:40:19 user devstack@n-api.service[72343]: Connection: close Apr 11 18:40:19 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:40:19 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:40:19 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:40:19 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:40:19 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNaT8TzUUFojRH6_oICimmQxJHoTCuva0i0gEMtrhQxGFlaOaTrF1WpybYF0kd4UBhKKiWhrTai1HP8RbTMRHhyxUvVodRS9bacYOgRcSC-XqWMeZCpJpvUZw1MGuFItFcWP-LLaWq-BTey0t6KiNM_GHaHweAYjRaQ_7j6idEGNchLY Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Project-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62a254c432f54e1b8735e40af7063506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Tenant-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:40:19 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:40:19 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:40:19 user devstack@n-api.service[72343]: X-User-Id: fde784625fda4447afc0b8e9bd0983a3 Apr 11 18:40:19 user devstack@n-api.service[72343]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:40:19 user devstack@n-api.service[72343]: method: > Apr 11 18:40:19 user devstack@n-api.service[72343]: exception: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. Apr 11 18:40:19 user devstack@n-api.service[72343]: action_args: {'id': 'bef10824-ced0-49d5-934a-c509ab119cbf'} Apr 11 18:40:19 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. Apr 11 18:40:19 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:19 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Returning 404 to user: Instance bef10824-ced0-49d5-934a-c509ab119cbf could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:40:19 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-0420bff3-3450-4ff6-ac04-0a8df5b7ee80 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf" status: 404 len: 111 microversion: 2.87 time: 0.040384 Apr 11 18:40:19 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 359/1086] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:40:19 2023] GET /compute/v2.1/servers/bef10824-ced0-49d5-934a-c509ab119cbf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=20 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:19 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:40:19 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 204 len: 0 microversion: 2.87 time: 0.110124 Apr 11 18:40:19 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 361/1087] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 18:40:19 2023] DELETE /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:19 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:20 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:40:20 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:40:20 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:40:20 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-800afa5e-f442-4399-a7ef-fb9eb301334d tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 200 len: 1694 microversion: 2.87 time: 0.170426 Apr 11 18:40:20 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 368/1088] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:40:19 2023] GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 18:40:20 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "name": "network-vif-unplugged", "status": "completed", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:40:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:20 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Creating event network-vif-unplugged:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:40:20 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033746 Apr 11 18:40:20 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 360/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:40:21 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "name": "network-vif-deleted", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:40:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:21 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] Creating event network-vif-deleted:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:40:21 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Apr 11 18:40:21 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 362/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:40:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:40:22 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d74109-f1ce-4361-a037-d23d348f8d3d", "name": "network-vif-plugged", "status": "completed", "tag": "d2ce54aa-8057-41b6-98ca-988a0fd0491c"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:40:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:22 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:22 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Creating event network-vif-plugged:d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance a0d74109-f1ce-4361-a037-d23d348f8d3d on user Apr 11 18:40:22 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054768 Apr 11 18:40:22 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 369/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:40:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e8431c6f-595b-4116-a5a5-e4e7364270d7 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-157897236", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5a259cdf-4526-4063-a555-34e2ab4d1097", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:40:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-e8431c6f-595b-4116-a5a5-e4e7364270d7 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] HTTP exception thrown: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. Apr 11 18:40:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e8431c6f-595b-4116-a5a5-e4e7364270d7 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:40:37 user devstack@n-api.service[72343]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 18:40:37 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:40:37 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:40:37 user devstack@n-api.service[72343]: Connection: close Apr 11 18:40:37 user devstack@n-api.service[72343]: Content-Length: 356 Apr 11 18:40:37 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:40:37 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:40:37 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:40:37 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:40:37 user devstack@n-api.service[72343]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:40:37 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:40:37 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:40:37 user devstack@n-api.service[72343]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:40:37 user devstack@n-api.service[72343]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:40:37 user devstack@n-api.service[72343]: Apr 11 18:40:37 user devstack@n-api.service[72343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-157897236", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5a259cdf-4526-4063-a555-34e2ab4d1097", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} Apr 11 18:40:37 user devstack@n-api.service[72343]: method: > Apr 11 18:40:37 user devstack@n-api.service[72343]: exception: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. Apr 11 18:40:37 user devstack@n-api.service[72343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-157897236', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5a259cdf-4526-4063-a555-34e2ab4d1097'}], 'networks': [{'uuid': '84f8f0e1-c59e-49b9-8a72-ef9903971259'}]}}} Apr 11 18:40:37 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. Apr 11 18:40:37 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:40:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-e8431c6f-595b-4116-a5a5-e4e7364270d7 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 400 to user: Block Device 5a259cdf-4526-4063-a555-34e2ab4d1097 is not bootable. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:40:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-e8431c6f-595b-4116-a5a5-e4e7364270d7 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.083246 Apr 11 18:40:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 361/1092] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:40:37 2023] POST /compute/v2.1/servers => generated 110 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:40:37 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:40:37 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c5e8aa01-f27f-4a1c-ad71-612cd2bb955e tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1495 microversion: 2.1 time: 0.143773 Apr 11 18:40:37 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 363/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:40:37 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1495 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:41:10 user devstack@n-api.service[72344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 18:41:10 user devstack@n-api.service[72344]: Tue Apr 11 18:41:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d (ip 10.0.0.210) !!! Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=8 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=14 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HTTP exception thrown: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Request method failure captured: Apr 11 18:41:10 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d HTTP/1.1 Apr 11 18:41:10 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:41:10 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:41:10 user devstack@n-api.service[72344]: Connection: close Apr 11 18:41:10 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:41:10 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:41:10 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:41:10 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:41:10 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNaT8TzUUFojRH6_oICimmQxJHoTCuva0i0gEMtrhQxGFlaOaTrF1WpybYF0kd4UBhKKiWhrTai1HP8RbTMRHhyxUvVodRS9bacYOgRcSC-XqWMeZCpJpvUZw1MGuFItFcWP-LLaWq-BTey0t6KiNM_GHaHweAYjRaQ_7j6idEGNchLY Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Project-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62a254c432f54e1b8735e40af7063506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62a254c432f54e1b8735e40af7063506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Tenant-Id: 62a254c432f54e1b8735e40af7063506 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:41:10 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:41:10 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:41:10 user devstack@n-api.service[72344]: X-User-Id: fde784625fda4447afc0b8e9bd0983a3 Apr 11 18:41:10 user devstack@n-api.service[72344]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member Apr 11 18:41:10 user devstack@n-api.service[72344]: method: > Apr 11 18:41:10 user devstack@n-api.service[72344]: exception: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. Apr 11 18:41:10 user devstack@n-api.service[72344]: action_args: {'id': 'a0d74109-f1ce-4361-a037-d23d348f8d3d'} Apr 11 18:41:10 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. Apr 11 18:41:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:41:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Returning 404 to user: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:41:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-c3341403-7639-42c2-86d5-6f6a41de45fd tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d" status: 404 len: 111 microversion: 2.87 time: 0.040910 Apr 11 18:41:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 370/1094] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 18:41:10 2023] GET /compute/v2.1/servers/a0d74109-f1ce-4361-a037-d23d348f8d3d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:13 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:14 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a6b53d8e-a848-4350-8686-af2865619064 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101966 Apr 11 18:41:14 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 362/1095] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 18:41:13 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-interface => generated 282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:14 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Creating event network-changed:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:41:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038625 Apr 11 18:41:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 364/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:15 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:15 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-11f7b5a0-1ab0-448d-add4-2b9a1afe7510 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/ips" status: 200 len: 107 microversion: 2.1 time: 0.041293 Apr 11 18:41:15 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 371/1097] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 18:41:15 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/ips => generated 107 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b266c6f4-cc30-408d-8d0c-85af691ff17b"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275161 Apr 11 18:41:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 363/1098] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:41:16 2023] POST /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:25 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'services' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:41:25 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments/b266c6f4-cc30-408d-8d0c-85af691ff17b" status: 202 len: 0 microversion: 2.1 time: 0.370889 Apr 11 18:41:25 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 365/1099] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:41:25 2023] DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments/b266c6f4-cc30-408d-8d0c-85af691ff17b => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:25 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:25 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-615b4c12-1a9a-4707-8da9-c3cf8547eef4 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051847 Apr 11 18:41:25 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 372/1100] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:41:25 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:37 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:41:37 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-23234872-c488-4f79-bb8a-742d412bd8d9 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1495 microversion: 2.1 time: 0.165813 Apr 11 18:41:37 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 364/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:41:37 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1495 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:41:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-024f3706-c401-4de7-94eb-e605a296a619 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: .version_select at 0x7fadb97277f0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1238772409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj4/a+30dtxmR6MUGwhoEYl8GIifPSNIynSaRLlu0oZvvc9/Zq+95CzpvMcSufeKo5wuH2TpcRMZQgr+7JiHjvAiErWC8TcY8YRD3cd+zkwp4RjBIgmlIzB4PYe3WN0SA=="}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:50 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-024f3706-c401-4de7-94eb-e605a296a619 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting quotas for project 24ae48f804e842e6818a90b8e1f61883. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:41:50 user devstack@n-api.service[72345]: DEBUG nova.quota [None req-024f3706-c401-4de7-94eb-e605a296a619 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting quotas for user 6fc3759f9d3f4ee987d60c348c755125 and project 24ae48f804e842e6818a90b8e1f61883. Resources: {'key_pairs'} {{(pid=72345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:41:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-024f3706-c401-4de7-94eb-e605a296a619 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.250018 Apr 11 18:41:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 366/1102] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 18:41:50 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:51 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-995235225", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1238772409", "security_groups": [{"name": "tempest-secgroup-smoke-1224616671"}], "networks": [{"uuid": "d408d034-2f25-487e-ad89-2ec213c6b021"}]}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:51 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:51 user devstack@n-api.service[72344]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] validate_networks() for [('d408d034-2f25-487e-ad89-2ec213c6b021', None, None, None, None, None)] {{(pid=72344) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flavor limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Image limits 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flavor pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Image pref 0:0:0 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting quotas for project 24ae48f804e842e6818a90b8e1f61883. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.quota [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting quotas for user 6fc3759f9d3f4ee987d60c348c755125 and project 24ae48f804e842e6818a90b8e1f61883. Resources: {'instances', 'cores', 'ram'} {{(pid=72344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Going to run 1 instances... {{(pid=72344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 18:41:52 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a1872eb-6a9a-4f78-b970-289fd877ea0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 18:41:52 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.823073 Apr 11 18:41:52 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 373/1103] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:41:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 18:41:52 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-a1d6e8c3-c0a1-4441-8091-f7a67bc37460 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:41:52 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-a1d6e8c3-c0a1-4441-8091-f7a67bc37460 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:41:52 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:52 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:41:52 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-a1d6e8c3-c0a1-4441-8091-f7a67bc37460 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc3759f9d3f4ee987d60c348c755125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ae48f804e842e6818a90b8e1f61883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:41:52 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-a1d6e8c3-c0a1-4441-8091-f7a67bc37460 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 200 len: 1256 microversion: 2.1 time: 0.096964 Apr 11 18:41:52 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 365/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:41:52 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 1256 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:41:55 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:55 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Creating event network-changed:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:41:55 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036305 Apr 11 18:41:55 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 367/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:56 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "name": "network-vif-plugged", "status": "completed", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Creating event network-vif-plugged:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:41:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047920 Apr 11 18:41:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 374/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:41:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "name": "network-vif-plugged", "status": "completed", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:41:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:41:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:41:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:41:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Creating event network-vif-plugged:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:41:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040513 Apr 11 18:41:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 366/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:41:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell0:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:15 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:15 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f465bdb0-e490-4a64-878c-ee8333f607ce tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052012 Apr 11 18:42:15 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 368/1108] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:42:15 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell0:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:16 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Going to try to terminate instance {{(pid=72344) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:42:16 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 204 len: 0 microversion: 2.1 time: 0.139451 Apr 11 18:42:16 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 375/1109] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:42:16 2023] DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell0:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:16 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:42:16 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-99bede33-fcd3-4cad-aecf-899056e92e5e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 200 len: 1669 microversion: 2.1 time: 0.277579 Apr 11 18:42:16 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 367/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:42:16 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 1669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:42:16 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "name": "network-vif-unplugged", "status": "completed", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:42:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:16 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Creating event network-vif-unplugged:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:42:16 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123905 Apr 11 18:42:16 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 369/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:42:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:42:18 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "name": "network-vif-plugged", "status": "completed", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}, {"server_uuid": "d2623107-c830-4c81-a534-b5d7dc0ca10f", "name": "network-vif-deleted", "tag": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:42:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:18 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Creating event network-vif-plugged:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:42:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Creating event network-vif-deleted:83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f on user Apr 11 18:42:18 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037439 Apr 11 18:42:18 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 376/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:42:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b5aa3e8-a8ee-4bd6-b331-d0e08d84fc1f tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1215216949", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "destination_type": "local"}, {"source_type": "volume", "uuid": "4b8ed277-4147-4d4b-b597-8622da530d6d", "destination_type": "invalid"}], "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:42:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b5aa3e8-a8ee-4bd6-b331-d0e08d84fc1f tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:42:39 user devstack@n-api.service[72343]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 18:42:39 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:42:39 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:42:39 user devstack@n-api.service[72343]: Connection: close Apr 11 18:42:39 user devstack@n-api.service[72343]: Content-Length: 494 Apr 11 18:42:39 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:42:39 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:42:39 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:42:39 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:42:39 user devstack@n-api.service[72343]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:42:39 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:42:39 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:42:39 user devstack@n-api.service[72343]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:42:39 user devstack@n-api.service[72343]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:42:39 user devstack@n-api.service[72343]: Apr 11 18:42:39 user devstack@n-api.service[72343]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1215216949", "imageRef": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6a1872eb-6a9a-4f78-b970-289fd877ea0f", "destination_type": "local"}, {"source_type": "volume", "uuid": "4b8ed277-4147-4d4b-b597-8622da530d6d", "destination_type": "invalid"}], "networks": [{"uuid": "84f8f0e1-c59e-49b9-8a72-ef9903971259"}]}} Apr 11 18:42:39 user devstack@n-api.service[72343]: method: > Apr 11 18:42:39 user devstack@n-api.service[72343]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 18:42:39 user devstack@n-api.service[72343]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1215216949', 'imageRef': '6a1872eb-6a9a-4f78-b970-289fd877ea0f', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '6a1872eb-6a9a-4f78-b970-289fd877ea0f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '4b8ed277-4147-4d4b-b597-8622da530d6d', 'destination_type': 'invalid'}], 'networks': [{'uuid': '84f8f0e1-c59e-49b9-8a72-ef9903971259'}]}}} Apr 11 18:42:39 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise error Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 18:42:39 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:42:39 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-7b5aa3e8-a8ee-4bd6-b331-d0e08d84fc1f tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:42:39 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-7b5aa3e8-a8ee-4bd6-b331-d0e08d84fc1f tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010582 Apr 11 18:42:39 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 368/1113] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 18:42:39 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=8 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:39 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:42:39 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-13409e10-4d2d-49b3-8ecc-eb84bcdeae21 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1495 microversion: 2.1 time: 0.142692 Apr 11 18:42:39 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 370/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:42:39 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1495 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:42:42 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc3759f9d3f4ee987d60c348c755125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ae48f804e842e6818a90b8e1f61883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:42:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-3189787f-0822-4c70-9aec-02aca527f0a5 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 200 len: 1569 microversion: 2.1 time: 0.167893 Apr 11 18:42:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 377/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:42:42 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:06 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f HTTP/1.1 Apr 11 18:43:06 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:43:06 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:43:06 user devstack@n-api.service[72343]: Connection: close Apr 11 18:43:06 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:43:06 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:43:06 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:43:06 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:43:06 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:06 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:43:06 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:43:06 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:06 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:06 user devstack@n-api.service[72343]: method: > Apr 11 18:43:06 user devstack@n-api.service[72343]: exception: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:06 user devstack@n-api.service[72343]: action_args: {'id': 'd2623107-c830-4c81-a534-b5d7dc0ca10f'} Apr 11 18:43:06 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:06 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:06 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:06 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-18bca203-b2f2-4069-9775-242045e6278e tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 404 len: 111 microversion: 2.1 time: 0.035112 Apr 11 18:43:06 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 369/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:06 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:06 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-1d800a31-9938-4973-8f37-66cf0ecd34ed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '.version_select at 0x7fadb97985e0>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:06 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:06 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-1d800a31-9938-4973-8f37-66cf0ecd34ed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994113133" status: 202 len: 0 microversion: 2.1 time: 0.026331 Apr 11 18:43:06 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 371/1117] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 18:43:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994113133 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:08 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f HTTP/1.1 Apr 11 18:43:08 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:43:08 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:43:08 user devstack@n-api.service[72344]: Connection: close Apr 11 18:43:08 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:43:08 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:43:08 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:43:08 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:43:08 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:08 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:43:08 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:43:08 user devstack@n-api.service[72344]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:08 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:08 user devstack@n-api.service[72344]: method: > Apr 11 18:43:08 user devstack@n-api.service[72344]: exception: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72344]: action_args: {'id': 'd2623107-c830-4c81-a534-b5d7dc0ca10f'} Apr 11 18:43:08 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:08 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-dbaac705-d841-4236-a8c2-8c6d1375d53c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 404 len: 111 microversion: 2.1 time: 0.043674 Apr 11 18:43:08 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 378/1118] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:08 2023] DELETE /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:08 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f HTTP/1.1 Apr 11 18:43:08 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:43:08 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:43:08 user devstack@n-api.service[72343]: Connection: close Apr 11 18:43:08 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:43:08 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:43:08 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:43:08 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:43:08 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:08 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:43:08 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:43:08 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:08 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:08 user devstack@n-api.service[72343]: method: > Apr 11 18:43:08 user devstack@n-api.service[72343]: exception: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72343]: action_args: {'id': 'd2623107-c830-4c81-a534-b5d7dc0ca10f'} Apr 11 18:43:08 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. Apr 11 18:43:08 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:08 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance d2623107-c830-4c81-a534-b5d7dc0ca10f could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:08 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-f67a14a6-ed8a-44ca-858b-ab9f96dfbd15 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f" status: 404 len: 111 microversion: 2.1 time: 0.031459 Apr 11 18:43:08 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 370/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:08 2023] GET /compute/v2.1/servers/d2623107-c830-4c81-a534-b5d7dc0ca10f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:09 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 HTTP/1.1 Apr 11 18:43:09 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:43:09 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:43:09 user devstack@n-api.service[72345]: Connection: close Apr 11 18:43:09 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:43:09 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:43:09 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:43:09 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:43:09 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72345]: method: > Apr 11 18:43:09 user devstack@n-api.service[72345]: exception: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: action_args: {'id': '9a1efd21-1752-4335-841a-3669ac667247'} Apr 11 18:43:09 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-8317e026-de67-475d-bc9e-1aa218f22c6a tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 404 len: 111 microversion: 2.1 time: 0.039074 Apr 11 18:43:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 372/1120] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:09 2023] DELETE /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:09 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 HTTP/1.1 Apr 11 18:43:09 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:43:09 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:43:09 user devstack@n-api.service[72344]: Connection: close Apr 11 18:43:09 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:43:09 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:43:09 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:43:09 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:43:09 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72344]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:09 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72344]: method: > Apr 11 18:43:09 user devstack@n-api.service[72344]: exception: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72344]: action_args: {'id': '9a1efd21-1752-4335-841a-3669ac667247'} Apr 11 18:43:09 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. Apr 11 18:43:09 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 9a1efd21-1752-4335-841a-3669ac667247 could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:09 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e6d1ca10-5be3-48da-a995-c91d1d536795 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247" status: 404 len: 111 microversion: 2.1 time: 0.032869 Apr 11 18:43:09 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 379/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:09 2023] GET /compute/v2.1/servers/9a1efd21-1752-4335-841a-3669ac667247 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:09 user devstack@n-api.service[72343]: request: DELETE /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b HTTP/1.1 Apr 11 18:43:09 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:43:09 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:43:09 user devstack@n-api.service[72343]: Connection: close Apr 11 18:43:09 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:43:09 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:43:09 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:43:09 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:43:09 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:09 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72343]: method: > Apr 11 18:43:09 user devstack@n-api.service[72343]: exception: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72343]: action_args: {'id': '8f7d2851-f711-4dc2-8166-133ea16c6a1b'} Apr 11 18:43:09 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:09 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-59b293dc-b4e6-4610-b178-10b7e1f9d454 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 404 len: 111 microversion: 2.1 time: 0.033230 Apr 11 18:43:09 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 371/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:09 2023] DELETE /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:09 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b HTTP/1.1 Apr 11 18:43:09 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:43:09 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:43:09 user devstack@n-api.service[72345]: Connection: close Apr 11 18:43:09 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:43:09 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:43:09 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:43:09 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:43:09 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:09 user devstack@n-api.service[72345]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:09 user devstack@n-api.service[72345]: method: > Apr 11 18:43:09 user devstack@n-api.service[72345]: exception: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: action_args: {'id': '8f7d2851-f711-4dc2-8166-133ea16c6a1b'} Apr 11 18:43:09 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. Apr 11 18:43:09 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:09 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:09 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-f8486f87-e546-4173-a4e8-b9c1f59461a6 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b" status: 404 len: 111 microversion: 2.1 time: 0.032624 Apr 11 18:43:09 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 373/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:09 2023] GET /compute/v2.1/servers/8f7d2851-f711-4dc2-8166-133ea16c6a1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:10 user devstack@n-api.service[72344]: request: DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df HTTP/1.1 Apr 11 18:43:10 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:43:10 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:43:10 user devstack@n-api.service[72344]: Connection: close Apr 11 18:43:10 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:43:10 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:43:10 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:43:10 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:43:10 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:10 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:43:10 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:43:10 user devstack@n-api.service[72344]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:10 user devstack@n-api.service[72344]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:10 user devstack@n-api.service[72344]: method: > Apr 11 18:43:10 user devstack@n-api.service[72344]: exception: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72344]: action_args: {'id': 'fbf10cce-a01c-4e3f-8212-a2a0d42713df'} Apr 11 18:43:10 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:10 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-5f9c6df6-f975-4a9f-8c95-fd37bb5af318 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 404 len: 111 microversion: 2.1 time: 0.028376 Apr 11 18:43:10 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 380/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:10 2023] DELETE /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:10 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HTTP exception thrown: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Request method failure captured: Apr 11 18:43:10 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df HTTP/1.1 Apr 11 18:43:10 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:43:10 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:43:10 user devstack@n-api.service[72343]: Connection: close Apr 11 18:43:10 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:43:10 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:43:10 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:43:10 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:43:10 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNabzrqcSrQzD4iZcGfnBomzb2LrEcbx9qKCKP9snwsV2b6pzGJSt14GYPnVyuRsPglT82AG4U94frAqItskUPU-4o37JJ88wjoirVnLhW2YL7CAmEd8WHQHc1vKia3LaAMTDNa5owWxuGtZMprwmkyJ8k_P8zHwk51q-gv6pVTePqIo Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Project-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a92ba4ae3f244cfc9f3f0732ab9cc649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Tenant: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Tenant-Id: a92ba4ae3f244cfc9f3f0732ab9cc649 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1806714760 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-User: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:10 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:43:10 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:43:10 user devstack@n-api.service[72343]: X-User-Id: b91adf882c384c8c9e27a24a8c55b0a1 Apr 11 18:43:10 user devstack@n-api.service[72343]: X-User-Name: tempest-AttachVolumeNegativeTest-1806714760-project-member Apr 11 18:43:10 user devstack@n-api.service[72343]: method: > Apr 11 18:43:10 user devstack@n-api.service[72343]: exception: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72343]: action_args: {'id': 'fbf10cce-a01c-4e3f-8212-a2a0d42713df'} Apr 11 18:43:10 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:10 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:11 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:11 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:11 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:11 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. Apr 11 18:43:11 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:43:11 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Returning 404 to user: Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:11 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2a1b0e66-2a9b-48ce-9da6-6a59e5f34601 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df" status: 404 len: 111 microversion: 2.1 time: 0.038662 Apr 11 18:43:11 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 372/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:10 2023] GET /compute/v2.1/servers/fbf10cce-a01c-4e3f-8212-a2a0d42713df => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=4 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] HTTP exception thrown: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:43:41 user devstack@n-api.service[72345]: request: DELETE /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac HTTP/1.1 Apr 11 18:43:41 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:43:41 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:43:41 user devstack@n-api.service[72345]: Connection: close Apr 11 18:43:41 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:43:41 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:43:41 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:43:41 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:43:41 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:41 user devstack@n-api.service[72345]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:43:41 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:43:41 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:43:41 user devstack@n-api.service[72345]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:43:41 user devstack@n-api.service[72345]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:43:41 user devstack@n-api.service[72345]: method: > Apr 11 18:43:41 user devstack@n-api.service[72345]: exception: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:41 user devstack@n-api.service[72345]: action_args: {'id': '73cbcd59-6e6a-4950-8dae-738f3b7151ac'} Apr 11 18:43:41 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:41 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:43:41 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 404 to user: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:41 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-dd95a78a-10e4-4f2a-8d98-2853b0c6f05d tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 404 len: 111 microversion: 2.1 time: 0.042864 Apr 11 18:43:41 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 374/1126] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:41 2023] DELETE /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:41 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.wsgi [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] HTTP exception thrown: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:43:42 user devstack@n-api.service[72344]: request: GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac HTTP/1.1 Apr 11 18:43:42 user devstack@n-api.service[72344]: Accept: application/json Apr 11 18:43:42 user devstack@n-api.service[72344]: Accept-Encoding: identity Apr 11 18:43:42 user devstack@n-api.service[72344]: Connection: close Apr 11 18:43:42 user devstack@n-api.service[72344]: Content-Length: 0 Apr 11 18:43:42 user devstack@n-api.service[72344]: Content-Type: application/json Apr 11 18:43:42 user devstack@n-api.service[72344]: Host: 10.0.0.210 Apr 11 18:43:42 user devstack@n-api.service[72344]: Openstack-System-Scope: None Apr 11 18:43:42 user devstack@n-api.service[72344]: User-Agent: python-urllib3/1.26.15 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Domain-Id: None Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Domain-Name: None Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Identity-Status: Confirmed Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Is-Admin-Project: True Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Project-Domain-Id: default Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Project-Domain-Name: Default Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Role: member,reader Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Roles: member,reader Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:43:42 user devstack@n-api.service[72344]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:43:42 user devstack@n-api.service[72344]: X-User-Domain-Id: default Apr 11 18:43:42 user devstack@n-api.service[72344]: X-User-Domain-Name: Default Apr 11 18:43:42 user devstack@n-api.service[72344]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:43:42 user devstack@n-api.service[72344]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:43:42 user devstack@n-api.service[72344]: method: > Apr 11 18:43:42 user devstack@n-api.service[72344]: exception: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:42 user devstack@n-api.service[72344]: action_args: {'id': '73cbcd59-6e6a-4950-8dae-738f3b7151ac'} Apr 11 18:43:42 user devstack@n-api.service[72344]: {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. Apr 11 18:43:42 user devstack@n-api.service[72344]: ERROR nova.api.openstack.wsgi Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 404 to user: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. {{(pid=72344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:43:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-2c7670b8-2400-4dc1-9c5d-a06e5e57b5ed tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac" status: 404 len: 111 microversion: 2.1 time: 0.050360 Apr 11 18:43:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 381/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:41 2023] GET /compute/v2.1/servers/73cbcd59-6e6a-4950-8dae-738f3b7151ac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=8 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Going to try to terminate instance {{(pid=72343) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:43:42 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 204 len: 0 microversion: 2.1 time: 0.226394 Apr 11 18:43:42 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 373/1128] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:43:42 2023] DELETE /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72345]: DEBUG nova.policy [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72345) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:43:42 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-15ac7d37-ef63-4ac2-8dff-b580245bb552 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 200 len: 1501 microversion: 2.1 time: 0.211096 Apr 11 18:43:42 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 375/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:42 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 1501 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-unplugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Creating event network-vif-unplugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:42 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034865 Apr 11 18:43:42 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 382/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:42 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:43 user devstack@n-api.service[72343]: DEBUG nova.policy [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc3759f9d3f4ee987d60c348c755125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ae48f804e842e6818a90b8e1f61883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72343) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:43:43 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-45cfadf5-83c5-4f34-a040-d698059e0cdf tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 200 len: 1569 microversion: 2.1 time: 0.288867 Apr 11 18:43:43 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 374/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:43:42 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 1569 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:43:43 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-deleted", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:43:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:43 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] Creating event network-vif-deleted:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:43 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037083 Apr 11 18:43:43 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 376/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:43:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:43:44 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}, {"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}, {"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}, {"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-unplugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}, {"server_uuid": "f692dcf6-6347-40f3-9e6a-cff075a18370", "name": "network-vif-plugged", "status": "completed", "tag": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:43:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:44 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Creating event network-vif-unplugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Creating event network-vif-plugged:4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance f692dcf6-6347-40f3-9e6a-cff075a18370 on user Apr 11 18:43:44 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.156729 Apr 11 18:43:44 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 383/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:43:46 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:43:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:46 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Creating event network-changed:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b148d1b-7887-4ab7-8f6b-abdad0cc44c7"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:43:46 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041904 Apr 11 18:43:46 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 375/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:46 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277479 Apr 11 18:43:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 377/1135] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:43:46 2023] POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:58 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'services' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:43:59 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/1b148d1b-7887-4ab7-8f6b-abdad0cc44c7" status: 202 len: 0 microversion: 2.1 time: 0.171978 Apr 11 18:43:59 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 384/1136] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:43:58 2023] DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:43:59 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:43:59 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-83471b4c-ff2b-44b6-93ec-ab4c4b633b67 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067668 Apr 11 18:43:59 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 376/1137] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:43:59 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=8 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.wsgi [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] HTTP exception thrown: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Request method failure captured: Apr 11 18:44:32 user devstack@n-api.service[72345]: request: GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 HTTP/1.1 Apr 11 18:44:32 user devstack@n-api.service[72345]: Accept: application/json Apr 11 18:44:32 user devstack@n-api.service[72345]: Accept-Encoding: identity Apr 11 18:44:32 user devstack@n-api.service[72345]: Connection: close Apr 11 18:44:32 user devstack@n-api.service[72345]: Content-Length: 0 Apr 11 18:44:32 user devstack@n-api.service[72345]: Content-Type: application/json Apr 11 18:44:32 user devstack@n-api.service[72345]: Host: 10.0.0.210 Apr 11 18:44:32 user devstack@n-api.service[72345]: Openstack-System-Scope: None Apr 11 18:44:32 user devstack@n-api.service[72345]: User-Agent: python-urllib3/1.26.15 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Auth-Token: gAAAAABkNahVhJTrJjr3PBo0oAg55qIXxjvoW0YSbUmdlSZrKcTG6dmEWqDyUaaymdXdhIOJUuc9cIlQKUbOP8gkCynz-009XVV5M9-x1NwmoHMJr78oYLA1159s55c1-mBOYxvwzD7OvpdUseDH1RpHcKVNG_MtFT_czyifT_TrvY-89rpWOrM Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Domain-Id: None Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Domain-Name: None Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Identity-Status: Confirmed Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Is-Admin-Project: True Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Project-Domain-Id: default Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Project-Domain-Name: Default Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Project-Id: 423994357c024575acae85fb885f4069 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Project-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Role: member,reader Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Roles: member,reader Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/423994357c024575acae85fb885f4069"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/423994357c024575acae85fb885f4069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Tenant: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Tenant-Id: 423994357c024575acae85fb885f4069 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1378388549 Apr 11 18:44:32 user devstack@n-api.service[72345]: X-User: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:44:32 user devstack@n-api.service[72345]: X-User-Domain-Id: default Apr 11 18:44:32 user devstack@n-api.service[72345]: X-User-Domain-Name: Default Apr 11 18:44:32 user devstack@n-api.service[72345]: X-User-Id: 423f3e46d47448fb880c9eeb1281565a Apr 11 18:44:32 user devstack@n-api.service[72345]: X-User-Name: tempest-ServersNegativeTestJSON-1378388549-project-member Apr 11 18:44:32 user devstack@n-api.service[72345]: method: > Apr 11 18:44:32 user devstack@n-api.service[72345]: exception: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. Apr 11 18:44:32 user devstack@n-api.service[72345]: action_args: {'id': 'f692dcf6-6347-40f3-9e6a-cff075a18370'} Apr 11 18:44:32 user devstack@n-api.service[72345]: {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. Apr 11 18:44:32 user devstack@n-api.service[72345]: ERROR nova.api.openstack.wsgi Apr 11 18:44:32 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Returning 404 to user: Instance f692dcf6-6347-40f3-9e6a-cff075a18370 could not be found. {{(pid=72345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:44:32 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-c7464657-c7c8-4f5c-bbd3-f34fe5875b81 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370" status: 404 len: 111 microversion: 2.1 time: 0.037961 Apr 11 18:44:32 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 378/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:44:32 2023] GET /compute/v2.1/servers/f692dcf6-6347-40f3-9e6a-cff075a18370 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-e669bb10-adc3-4e2f-9b2a-6984e5c8df47 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051631 Apr 11 18:44:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 385/1139] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:44:49 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "242257f8-c35f-4a7c-9e16-ca31bbbbd14d"}} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=6 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:50 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:51 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276002 Apr 11 18:44:51 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 377/1140] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:44:50 2023] POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:58 user devstack@n-api.service[72345]: DEBUG nova.objects.instance [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'services' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=72345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:44:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/242257f8-c35f-4a7c-9e16-ca31bbbbd14d" status: 202 len: 0 microversion: 2.1 time: 0.188131 Apr 11 18:44:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 379/1141] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:44:58 2023] DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/242257f8-c35f-4a7c-9e16-ca31bbbbd14d => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:44:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:44:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8a446666-585f-4dce-b358-d5e490bdbd3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048774 Apr 11 18:44:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 386/1142] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:44:58 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-854bb7bb-4e6a-49bc-9a87-1e5affd6e177 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053764 Apr 11 18:45:48 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 378/1143] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:45:48 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e3c52e-193a-4f9c-bc38-3221648202f9"}} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:50 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:50 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292428 Apr 11 18:45:50 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 380/1144] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:45:50 2023] POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=4 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=12 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:57 user devstack@n-api.service[72344]: DEBUG nova.objects.instance [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'services' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=72344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:45:57 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/08e3c52e-193a-4f9c-bc38-3221648202f9" status: 202 len: 0 microversion: 2.1 time: 0.159446 Apr 11 18:45:57 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 387/1145] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:45:57 2023] DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/08e3c52e-193a-4f9c-bc38-3221648202f9 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:45:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:45:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-838e2462-2baf-49d7-9930-6b9c09b331a6 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Apr 11 18:45:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 379/1146] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:45:57 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:47 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:47 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-4aa5e9c6-8e47-4b5b-923e-736851d88881 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056070 Apr 11 18:46:47 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 381/1147] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:46:47 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2167bcf1-6d9a-4442-9443-eebcfb42c66a"}} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:49 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:49 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272158 Apr 11 18:46:49 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 388/1148] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 18:46:49 2023] POST /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=12 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:57 user devstack@n-api.service[72343]: DEBUG nova.objects.instance [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'services' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=72343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 18:46:57 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/2167bcf1-6d9a-4442-9443-eebcfb42c66a" status: 202 len: 0 microversion: 2.1 time: 0.175755 Apr 11 18:46:57 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 380/1149] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 18:46:57 2023] DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments/2167bcf1-6d9a-4442-9443-eebcfb42c66a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:46:57 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:46:57 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-849fabba-df66-40bd-b7a7-7631c314a2cc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048956 Apr 11 18:46:57 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 382/1150] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:46:57 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:47 user devstack@n-api.service[72344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 18:47:47 user devstack@n-api.service[72344]: Tue Apr 11 18:47:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:47 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:47 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-8256553a-5c5f-444d-a65f-7539b651e183 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057985 Apr 11 18:47:47 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 389/1151] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 18:47:47 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=2 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:55 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Creating event network-changed:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:47:55 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103978 Apr 11 18:47:55 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 381/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:47:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:47:58 user devstack@n-api.service[72345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 18:47:58 user devstack@n-api.service[72345]: Tue Apr 11 18:47:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 (ip 10.0.0.210) !!! Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=2 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=6 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72345) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:58 user devstack@n-api.service[72345]: DEBUG nova.compute.api [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Going to try to terminate instance {{(pid=72345) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 18:47:58 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 204 len: 0 microversion: 2.1 time: 0.140767 Apr 11 18:47:58 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 383/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 18:47:58 2023] DELETE /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG nova.compute.api [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72344) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_api:SELECT=2 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG dbcounter [-] [72344] Writing DB stats nova_cell1:SELECT=6 {{(pid=72344) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:58 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "name": "network-vif-unplugged", "status": "completed", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:47:58 user devstack@n-api.service[72344]: DEBUG nova.policy [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc3759f9d3f4ee987d60c348c755125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ae48f804e842e6818a90b8e1f61883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72344) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 18:47:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:58 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:58 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [None req-27a98b4a-b17d-43ce-b58c-3f631d37db3a tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 200 len: 1575 microversion: 2.1 time: 0.310954 Apr 11 18:47:58 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 390/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:47:58 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 1575 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 18:47:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.compute.server_external_events [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Creating event network-vif-unplugged:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:47:58 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036300 Apr 11 18:47:58 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 382/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:47:59 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "name": "network-vif-deleted", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:47:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:47:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:47:59 user devstack@n-api.service[72345]: DEBUG oslo_concurrency.lockutils [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72345) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:47:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.compute.server_external_events [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] Creating event network-vif-deleted:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:47:59 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030265 Apr 11 18:47:59 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 384/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:48:00 user devstack@n-api.service[72344]: DEBUG nova.api.openstack.wsgi [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beac0ff-4330-460f-b7c0-1c3ed9decfd5", "name": "network-vif-plugged", "status": "completed", "tag": "c5144516-ee85-4c97-b379-5e7300e428cb"}]} {{(pid=72344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 18:48:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:48:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:48:00 user devstack@n-api.service[72344]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72344) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:48:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.compute.server_external_events [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Creating event network-vif-plugged:c5144516-ee85-4c97-b379-5e7300e428cb for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 on user Apr 11 18:48:00 user devstack@n-api.service[72344]: INFO nova.api.openstack.requestlog [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030006 Apr 11 18:48:00 user devstack@n-api.service[72344]: [pid: 72344|app: 0|req: 391/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 18:48:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_api:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG dbcounter [-] [72343] Writing DB stats nova_cell1:SELECT=4 {{(pid=72343) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '>' {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG nova.compute.api [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Fetching instance by UUID {{(pid=72343) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG oslo_concurrency.lockutils [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "f7fb2d0a-21de-480a-91cc-7aa7c2ecd4f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72343) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 18:48:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.wsgi [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] HTTP exception thrown: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Request method failure captured: Apr 11 18:48:48 user devstack@n-api.service[72343]: request: GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 HTTP/1.1 Apr 11 18:48:48 user devstack@n-api.service[72343]: Accept: application/json Apr 11 18:48:48 user devstack@n-api.service[72343]: Accept-Encoding: identity Apr 11 18:48:48 user devstack@n-api.service[72343]: Connection: close Apr 11 18:48:48 user devstack@n-api.service[72343]: Content-Length: 0 Apr 11 18:48:48 user devstack@n-api.service[72343]: Content-Type: application/json Apr 11 18:48:48 user devstack@n-api.service[72343]: Host: 10.0.0.210 Apr 11 18:48:48 user devstack@n-api.service[72343]: Openstack-System-Scope: None Apr 11 18:48:48 user devstack@n-api.service[72343]: User-Agent: python-urllib3/1.26.15 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Auth-Token: gAAAAABkNannEIcazJAYdhLlxDgWPgKPXjLN0zPitjI4vxW3x3142pxR-MimcylNRfDDOOLvEHh97vPJ-aHNBfGPACfbJSYCYeIzWJU0WNYqbiZ3HLmpmDWIajQNficK5--Db1bVijfzSOmq-_4vVcFpRIIxwX0mpJ-kou1qCsn0VzYs026RXXw Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Domain-Id: None Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Domain-Name: None Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Identity-Status: Confirmed Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Is-Admin-Project: True Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Project-Domain-Id: default Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Project-Domain-Name: Default Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Project-Id: 24ae48f804e842e6818a90b8e1f61883 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1628398246 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Role: member,reader Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Roles: member,reader Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24ae48f804e842e6818a90b8e1f61883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24ae48f804e842e6818a90b8e1f61883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24ae48f804e842e6818a90b8e1f61883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Tenant: tempest-SnapshotDataIntegrityTests-1628398246 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Tenant-Id: 24ae48f804e842e6818a90b8e1f61883 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1628398246 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-User: tempest-SnapshotDataIntegrityTests-1628398246-project-member Apr 11 18:48:48 user devstack@n-api.service[72343]: X-User-Domain-Id: default Apr 11 18:48:48 user devstack@n-api.service[72343]: X-User-Domain-Name: Default Apr 11 18:48:48 user devstack@n-api.service[72343]: X-User-Id: 6fc3759f9d3f4ee987d60c348c755125 Apr 11 18:48:48 user devstack@n-api.service[72343]: X-User-Name: tempest-SnapshotDataIntegrityTests-1628398246-project-member Apr 11 18:48:48 user devstack@n-api.service[72343]: method: > Apr 11 18:48:48 user devstack@n-api.service[72343]: exception: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. Apr 11 18:48:48 user devstack@n-api.service[72343]: action_args: {'id': '2beac0ff-4330-460f-b7c0-1c3ed9decfd5'} Apr 11 18:48:48 user devstack@n-api.service[72343]: {{(pid=72343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. Apr 11 18:48:48 user devstack@n-api.service[72343]: ERROR nova.api.openstack.wsgi Apr 11 18:48:48 user devstack@n-api.service[72343]: DEBUG nova.api.openstack.wsgi [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Returning 404 to user: Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 could not be found. {{(pid=72343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 18:48:48 user devstack@n-api.service[72343]: INFO nova.api.openstack.requestlog [None req-2c408cfb-6065-41e9-bada-cab57cd07e7d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5" status: 404 len: 111 microversion: 2.1 time: 0.044992 Apr 11 18:48:48 user devstack@n-api.service[72343]: [pid: 72343|app: 0|req: 383/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 18:48:48 2023] GET /compute/v2.1/servers/2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 18:48:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:48:48 user devstack@n-api.service[72345]: DEBUG dbcounter [-] [72345] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72345) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 18:48:48 user devstack@n-api.service[72345]: DEBUG nova.api.openstack.wsgi [None req-a8143379-c7bc-41b5-8b27-8768ca6adfd1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Calling method '.version_select at 0x7fadb9a3b400>' {{(pid=72345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 18:48:48 user devstack@n-api.service[72345]: INFO nova.api.openstack.requestlog [None req-a8143379-c7bc-41b5-8b27-8768ca6adfd1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1238772409" status: 202 len: 0 microversion: 2.1 time: 0.039538 Apr 11 18:48:48 user devstack@n-api.service[72345]: [pid: 72345|app: 0|req: 385/1159] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 11 18:48:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1238772409 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)